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"HARim EDUCATION TUl^ORINO PROGRAM-' 

Prepared "by* Jerome A, Contee 

I, PROGRAM DESCKIPTION 
ThlB tutoring program was specifically designed to raise the schol- 
astic achievement level of selected participants, particularly in the 
basic skills areas of reading and mathematics. Identified by means of 
the Metropolitan Achifeven^nnt Test as being two or more years behind 
their normative level in reading and mathematics , the particlpajits lived 
in Central Harlemj were between the ages of 6»13 ajid ranged in grade 
level from 1=9* 

The "Harlem Education Tutoring ^ogr^-'was a functional coD^onent 
of a non-profit agency that has had a rich history in Central Harlem. Founded 
in July^ 19625 the Harlem Education Program^ Inc. (iffiP) is a commimity based 
program in that the Board of Directors ^ the Advisory Committee and the 
office staff are composed of neighborhood residents,, With offices located 
In a Sitorefront at 3I3 West lUjth Street ^ EEF operated the tutorial pro» 
gram plus a counseling and referral unit. The Board of Directors felt that, taken 
together, the tutor ial^ counseling and referral services constitute a 
conrprehenslve program that addressed itself to the educational and life 
support needs of both the tutees and their families* 
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Tutors for the tutorial component were recruited ftom New York City 
colleges and local high schools. Referrals to the program were made by 
guidance counselorii teachers ^ social workers, courts an(3 parents. Tutees 
ware referred from seven schools in the Central Harlem area. 

II. raOGRMd IMPIfflOTlATION 

The tutorial eonoponent utilised the service of one senior school 
neighborhood worker ^ one teacher ^ one parent program assistajitj two edu- 
cational assistants and eleven student aides. 

Prospective paj*ticipmts (tutees) and their parents were interviewed 
at the program site and after they were accepted 3 a tutor "TO^i assi^ed 
to meet with the student two days a week for two hours each session. A 
unique aspect of the program wai that tutoring sessions took place in 
the student *s home. 

Using the results of the Metropolitan Achievement tests as a basej student 
needs were assessed and the tutor ^ in consultation with the student 5 the student' 
teacher, the program teacher 5 and the parents/ established a remedial 
prograjn. Basic mathematics skills^ readlngj comprehension, vocabulary 
building, and study skills were the focus of most sessions . 

The tutorial component teacher was directly responsible for tutor 
assignments. One day per week (Fridayj h hours), the tutors held a 
meeting which included both in-service training workshops and individual 
counseling sessions under the teacher *s supervision. At those meetings, 
the teacher generally reviewed each tutor's work (including tutee prog-^ 
resi) from the previous week, gave technical assistance in special prob= 
lem areas and supervised the preparation of tutorial lesson plans for 
the next week. Also, the teacher and tutors discussed problems with 
the tutee and/or the family, the applicability of speGlfic tutoring 
materials and new teaching techniques. 
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In addition to the weekly meeting j each tutor receivefl an on-site 
visit from the supervising teacher on a rotating basis. These visits 
"by the teacher in the tutees ' homes lasted approximately one-half hour. 
Besides building relationships between the client and the agency^ they 
also served a diagnostic and evaluative piirposa. 

Ill, EVALUATrON DESIGN 

In order to determine the degree to which the Harlem Education 
Tutoring Prograjn met its objective of raising the scholastic achievement 
level of selected participants in the basic skills areas of reading and 
math 3 the following evaluation procediires were employed! 
Parent Survey ' • 

A three-page parent survey was given to selected parents to ascertain 
their perceptions of the tutoring program* 
2. Standardiz ed Test Scores 

As a measin^e of the tutorial program's effectiveness the Spring I97U 
reading subtest of the MAT (grade equivalent) was utilised as a pre-test 
score and the Spring 1975 rLmding comprehension subtest of the 1975 New 
York City public school standardized test (grade equivalent) was util- 
ized as a post-test score* 

Historical regression procedures were utilized to determine predic-- 
ted post- test scores for pupils in grades k through 8, Tim correlated 
t test was applied to test the significance of differences between pre^ 
dieted and observed post-test scores for children in these grades* 
Grades 2^3? ^^65 and 7^8 were combined bficause of low numbers in the 
separate grades. 

The historical regression was not applicable to grade 2 and there 
were only three students in grade 3- 
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IV. PROGRAM lETECTIVlNESS 
^ogram effectiveness "was determined by analysing the results of 
the evaluative procedures that were employed. Table 1 Indicates a per- 
centage rating for yes responses. Results frOT the Parent Survey indi- 
cate that those parents surveyed gave generally positive feedback in 
regards to the ten yes-no response questions* 

Table 1 

Parent Survey: Yes/No Response Questions 

io Rating for Yes Responses 



Questions ^j^^ggj 

1, Does your child like ttitoring? 90^ 

2. Does yom* child ta3^ about school? 83^ 

3- Does your child talk about tutoring? 93^ 

k. Does your child mnt to continue tutoring? 90^ 

5* Has your child's behavior changed for the 

better since being in the program? 83^ 

6. Do you feel positively about your child 

being tutored? 53^ 

7. Do you feel your child has learned 

something? 90^ 

8. Do you feel your child does better in 

school since being tutored? 83^ 

9* Have you es^ressed feelings about the 

program to prograjn personnel? 8o^ 

10. Did they listen to what you had to say? 80^ 



The pre-test MAT scores were used to determine e^^ected post=test 
achievement scores* Table 2 indicates the results of the comparison of 
the reading aehievement scores. The observed post-test scores demonstrated 
that there were significant gains in reading achievement for grades 2-3 * 
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however, grades U-S demonstrated a decline from the pre^test to the post" 
test scores s Also in grades U=6 the observed post-test was significantly 
less than the predicted post--test. Finally 5 grades 7-8 demonstrated a 
gain in reading achievement but there was no significant difference be- 
tween predicted poet-test and observed post-test scores. 

Table 2 

Comparison of Reading Achievement Scores of Participants 
in the Harlem Education Tutoring ProgrMi 



Pretest Predicted Posttest Observed Posttest 
Grade N Mean S*D, Mean S,D. Mean S,D, 



2-3 11 2.02 .63 m 2,2U .U8 2,61^ 

2U 3*^6 ,9^ 3.98 1.08 3,32 ,75 -if, 33* 

7-8 9 U.U9 1.28 U,9l l,i+s 5,21 1,35 1,33 
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NOTE: Tiie Observed Posttest Mean was significantly less than the Pre^ 
dieted Posttest mean for Grade 

^^Significant at .01 level 

V, PROGP^M SraENGTHS MTD \ffiAKNESSES 

The following strengths and weaknesses were. noted: 

Strengths 

By far 5 the prograjn's greatest strength was its comprehensive com- 
munity based service orientation. The staff viewed each progrM compo- 
nent (tutorial^ counseling and referral) as interlocking in regards to 
helping the target population acquire basic educational skills (tutorial 
con^onent) and daily life support skilla (counseling and referral). ^ 

Some specific strengths were: 

1, Besides tutorial services ^ the program offered counseling and 
referral services to both tutees and their parents in the areas of hous-^ 
ingj welfare, employments health, consumer education^ job training and 
child care. 

2, The agency established a direct reciprocal referral relation- 

in 
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ship with more than fifteen agencies in Central Harlem and Manhattan* 
3. The home factor was stressed ^ in that the tutor provided the 
service within the tutee's home setting* 

The progrMi was community-based. That is^ the program^ s Boi^d 
of Directors, the program administrators , the clients and the building 
site were located within the Central Harlem conffliimity, 

5. The pro-am stressed parent involvement. The tutees were ser- 
viced as members of a fMlly^ miit ajid p^ents were kept informed of Llie 
fact that the program also offered services to meet their needs. 
Weaknesses 

1* The prograjii lacked an on-site well-equipped classroom t^e 
facility for the in-service training aspect of the tutorial component, 

2, Referrals to the tutorial prograjn far outnimbered the open 
slots available, 

3. Because of the number of tutees, the supervising teacher could 
not develop a regular visitation schedule involving frequent visits. 

The number of meetings between the tutor and the tutee's regular 
classroom teacher were not of sufficient number to provide for optimum 
articulation between the tutorial and school programs. 



Yl . RECOMDNDATIONS 

1. The- tutorial component should be es^anded* This could be done 
with the addition of more tutors and possibly with the half-time as sis- 
tance of another supervising teacher. The half-time teacher would also 
allow the supervising teacher more time to engage in routine home visi- 
tation . 

2, Evaluative survey forms should be developed for assessing the 
Impact of the progr^ on tutees and parents. 
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3. An on-site classroom facility with necessary equipment could 
help improve both program efficiency and quality. Such a facility would 
he multi-piarposed 5 in that the supervising teacher and the tutors could 
use it both for In-service training and as ^ alternate tutoring site. 

This recoimnendation is contingent upon the availability of a school 
during the evening hours that could accomodate the tutorial program. The 
cost of keeping such a schoo3= open must also be considered. 



12 



FCEDHWd TJNIVERBITY 
SCHOOL OF EDUC/lTION 
INSTITUTffi FOR RESEMGH AND EVALUATION 



Final Report Ftmction No. 20-53^06 

July, 1975 

EVALimTION OF CITC-WIDE tl^mELLA I^OGRMS 

NEW YORK CITY BOARD OF EDUCATION . " 

197^ - 1975 SCHOOL YEAR 

"SGHOOL-CCTMUNITY NEIGIffiORHOOD CENTER" 

K*epared ^yi Jerome A, Contee 

I, PROGRAM DESCRIPTION 
The objectives of the Sehool-Community program were twofold i 

1. To orient and train District 5 parents in order that they may 
have a first hand knowledge of the Central Board of Education^ the local 
Board of Education, school personnel, school regulations and operational 
procedures, 

2. To provide tutorial services for students who were in need of 
assistance in acquiring hasic skills in reading and arithmetic,^ 

The prograjn's rationale was centered around the belief that many 
District 5 parents feel alienated from their children's schools, have 
no overt lines of communication with school personnel and have no clear 
idea of how to ascertain their children's progress in school. At the 
same time New York City Board of Education data indicated that District 5 
studentswere far below the national norm in reading and mathematics. 

The specific criteria established for pajfticipation in the prograjn 

were: 

1, Thm parent must have a child presently enrolled in a District 5 
school and demonstrate a lack of knowledge concGrning the local educational 
agency, its structures, laws and functions. 
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2, The itudenti must be preient3^ enrolled in a Distriet 5 school. 

3. Both parenti ajnd students must demonstrate a strong desire to 
participate in the program* 

The first objective tos to be achieved through workshops ajid meet- 
ingi sponsored by the School Commimity program and varied corranimity 
groups and agencies* The original intent was to give intensive training 
to forty parent participants with the focus being primarily upon the 
structure 3 laws and functions of the Central Board of Education, the 
Community School Board and the local School District. 

Instead of the intensive training program focusing on one area and 
including forty parents ^ the program^ was modified to include 
a series of diverse workshops with different participants at each work- 
shop. FiX'-e hundred parents participated in 21 workshops. The workshop 
topics were suggested by parents and included Mftong others Special Edu- 
cation ^ School Board Elections, Student Records and Central Board Duties 
and Responsibilities* 

The second objective was to be achieved through a tutorial program 
adminlsbered by 10 teacher aids from 'Columbia University under the super- 
vision of a licensed teacher. Thu prograjn operated five days a week from 
3-30 P*M* to 8*30 P.M* throughout the school term. Recruitment of stu- 
dents to be tutored was done by workshop participant parents 'yAio assem- 
bled lists of students in need of remediation* ^e total number of tu- 
teeswas 55, Evaluation of this aspect of the program to.s accomplished 
by using the Metropolitan Achievement Test as a pre= and post-test, 

II-. raOORAM mPtEMENTATION 
The prograjn is staffed hyi one program coordinator, two senior school- 
neighborhood workers 5 one parent program assistant, one family worker ^ one 
teacher^ one clerk^typlst, and ten teacher aides (tutors), 
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Each of the 21 workshops wmi viewed by the School-Coimiynlty l^oject 
as aiding in the development of cadres of parents who exajnined specific 
school-oriented issues through formliaed workshops. 

The training cwriculum for the selected parent cadres was originally 
designed to^ include some of the following knowledge areas i 

(a) The New York City Board of Education, its origin^ history, hc^ 

it operates and the majiner in which key policy decisions affect the schooli, 

(b) ^e New York City public school Central Administration^ its vari- 
ous imits and divisions plus- the functioning of key personnel, 

(c) The decentralization law and the structwe of local school dis- 
tricts with a special emphasis on the structure and functioning of Dis- 
trict 5* 

(d) The organization and functioning of parent advisory councils, 

(e) The School Board election process, 

(f) Student Rights and the Maintenance of School Records, 

Among other duties , the two Senior School-Neighborhood Workers handled 
the logistics of finding workshop space and providing needed materials; 
they also coordinated aspects of the tutorial program, visited schools 
and functioned as advocates for both students and parents. The two parent 
progr&n assistants assisted the Senior School-Neighborhood Workers and 
acted generally as a liaison between the program and the coiranimity. 

The tutorial prograjn ran from 3:30 to 8i30^ Monday through Friday^ 
both on the program premises and, at times, in students' homes, Fridays 
were also used for staff meetings and in-service training. Tutors kept 
a log on the work of their students and were in contact with both the 
parents and the regular classroom teacher. Besides basic remedial read- 
ing and mathematics work the tutees were encouraged to participate in 
Intellectual ga^es such as scrabble and chess, Once a month cultural 
enrichment trips were taken to such places as the United Nations and the 

ERIC 
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III, EVALUATION DESIGN 
In order to determine the degree to which the Sehool-Coramunlty Pro 
gr^ met its obdectives of (a) orienting and training District 5 parent 
in apecific school oriented areas ond (b) providing tutorial services 
for District 5 etudents in Reading and Arithmetic ^ the following evalu- 
ation procedures were employed* 
1* Parent Survey 

A three-page parent survey was given to selected pa^ente to ascer- 
tain their perceptions of the tutoring program, '^7 

2. Student Records Survey 

A one -page ^ l7-item Student Records Survey was administered to 22 
parents who attended the April I?, Ip75 Student Records Workshop. It 
was expected that 73% of the surveyed parents would give a correct re- 
sponse to 65^ of the items. 

3. Standardiged Test Scores 

As a measTore of the tutorial prograjn^s effectiveness 3 the Spring 
197^ reading subtest of the !^ (grade, equivalent) was utilized as a 
pre-test score and the Spring 1975 reading comprehension subtest of the 
Naw York City public school standardized tests (grade equivalent) was 
utilized as a post-test score. 

Historical regression procedures were utilized to detemine pre- 
dicted post-test scores and the correlated t test ms applied to test 
the significance of differences between predicted and observed post-test 
scores. Grades 3-5 were combined because of low numbers in the sepsu'ate 
grades, 

-TV. PROGRAM EFFECTIVENESS 

Prograjn effectiveness was determined by analyzing the results of 

the evaluation^ procedures that were employed. Table 1 indicates a percen 
tage rating for yes responses. Results from the Parent Survey indicate 
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that those parents who responded gave generally positive feedback with 
regard to the ten questions. 

Table 1 

• Parent Survey* Yee/No Responge Questloni 

Questioni ^ Rating for Yea Reapenses 

(N^IO) " 

1. Does child like tutoring? 
2/ Doei child talk about school? 
3» Does child talk about tutoring? 

Doei child want to continue tutoring? 

5, Has child behavior changed for the 
better since being in the program? 

6, Do you feel positively about your 
child being tutored? 

7, Do you feel your child has learned 
something? 

8* Do you feel your child does better in 
school since being tutored? 

9» Have you expressed feelings about the 
program to prograjn personnel? 

10, Did they listen to what you had to say? 

Table 2 details Student Rights Survey results. It was ejected that 
73% of the surveyed parents would give a correct response to 63% of the I7 
items listed on the Student Records Survey. Actamlly^ 73^ of the par- 
ents surveyed gave a correct response to 65^ of the Items, 
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Table g 

Student Rig zs Survey Results (N=S2) 



No. Correct Prequency Cumulative Frequenay 



17 ■ 1 1 

16 2 3 

15 1 k 

Ik 3 7 

13 If 11 

2 13(73fo got 65'^ 

, 3 16 correct) 

10 a 18 

a 1 22 



The pre=test MAT scoree were uised to detewnine expected poet-test 

achievement scores^ Comparisons were then made between predicted ^and 

observed post^test results utilizing a correlated t test. The re suit i 

are Presented in Table 3* The observed post-test scores demonstrated 

that there were gains in reading achievement ^ in grades 3-5 , and in grade 

but there were no significant differences between predicted and observed 
post-test means ^ There ms no observable gain in grade 7, 

Table 3 

Comparison of Reading Achievement Scores of Participante 
in the School -Community Tutoring ^ogram 



ftetest I^edicted Posttest Observed Posttest 

Grade N Mean S,D, Mean S.I), Mean S*D, t 

7 8 5.78 1.30 6.38 IM 

6 12 5.38 1.31 ^ 6.05 1.53 

3-5 10 3.01 0.8^ 3,51 l.o8 

^OTEt Negative t values indicate that observed posttest means were less 
than predicted posttest means. 



5^75 l,6o -0.93 
6.67 2.26 1.53 
3M 0.97 =0,20 
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V, mOGRAM STRENGTHS AND WmKKESSES 
The following strengths and weaknesses were noted: 
Strengthi 

1. THm pareht workshops worked well in terms of encouraging parents 
to become involved in school progrMe, In addition^ the units establiehed ' 
an informal referral network that disseminated information regarding non- 
educational commmilty service areas such as housing Md child care. 

2. By setting up and running workshops at different sites ^ the staff 
established reeiprocal working arrangements with other cMmimlty sger^cieSj 
such as the Housing Authority and the Public Education Association. 

3. The liaison between the. project staff and the parents plus the 
dally tutoring program encouraged the "community" aspect of the prograjn 
as opposed to the "worker -client" relationship so typical In. mny bureau- 
cratic agencies. 

Weaknesses 

1. Several project staff members spent an Inordinate amount of time 
negotiating with the Board of Education and several of the host schools for 
reimbursement payments and test scores, 

2. Some host school personnel had difficulty understanding that the 
tutorial prograin Is a public funded supplement to their educational progr^, 

3* Evaluation of the parent workshops was a persistent problem. Pew 
project workshops were formally evaluated In written form and project workers 
strongly felt that siarveying partiGipants created stress fa--^ ors charac- 
teristic of a test situation. 

V I , BEC OWffiNmTIONS 

1, Non-test oriented evaluative methods should be developed for 
each parent workshop and a written evaluation should be a part of each 
workshop . 
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2, A member of the program staff should be assigned the task of 
negotiating with the school bureaucracy, not only on behalf of the tutorial 
program but also to assist the organization of parent groups in terms of 
eetablishlng-a positive working relationship with Board of Education aiid 
host school personnel. 

3. Successful techniques and methods for working with large groupi 
of parents over periods of time shoiad be detailed and recorded in order 
to enhsjice the success of futiire parent workshops. 

The program has the potential to satisfy needs of parents. The 
program should be continued provided that the above recommendations are 
considered for implementation. 
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"RICHMIOTDTO™ ^STORATIOT EDUCATION PROJECT" 

Prepared by: Regis Bernhardt 

I, nfTRODUCTION 

The Richmondtown Restoration Education Project was a social studies 
program for New York City school children, Richmondtown, which is his = 
toricaljy and geographically the center of Staten Island , is a multi- 
acre restoration which e^diibits the evolution of an American village 
from the seventeenth through the nineteenth centuries. The Education 
Project was initially developed in 19683 through the cooperation of the 
Education Department of the Staten Island Historical Society and person- 
nel from Community School District #31* 

The Project^ s primary activity was to provide students with tours 
of the restored village during which crafts demonstrations were to be 
presented and information concerning American history provided. 

Rrogr^ personnel were also to visit schools to make presentations 
to classes or assemblies. Evening workshops were to be held for adults 
in which instruct ion^ by e^^ert craftsmen^ was to be provided in such 
areas as needlecraft^ pottery ^ leathercraft and colonial cooking. 

The Project was to be staffed by a full-time coordinator and nine 
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part-time paraprof esslonals . The coordinator was to be responsible for 
performing general administrative and supervisory tasks ^ acting as liaison 
with the Central Board of Ediication, and disseminating Information con^ 
cerning the ft-oject to schools and scheduling their visits. Paraprof es- 
slonals were to serve as guiaes for the school groups and to demonstrate 
crafts to the students, 

II. OBJECTIVES ATO EVALimTION DESIGN 
Program objectives as stated in the proposal for funding were: (l) 
to acquaint students with coimnimity and other resoiarces which would enrich 
or extend their learning of the role of the individual in community liv- 
ing; and (2) to increase students' understanding and appreciation of the 
American heritage. 

In order to evaluate the program with respect to these objectives, 
a test was aonstructed. The test was based upon a vocabulary list which 
was mailed to schools prior to visits. Project personnel reviewed a 
preliminary draft of the test to prevent ambiguities and inaccuracies, 
and a pilot test was conducted with a sixth grade class. Results of the 
pilot test were used to establish the minimum sample size for the evalu- 
ation, Pre-tests were mailed to teachers prior to the visits. The tests 
were completed again following the post-trip instructional period. Re- 
sults from the pre=.test and post-test were compared utilising a t test 
for correlated samples. 

Visits were made to the project site to observe project activities and 
to interview personnel. Questionnaires were completed by the personnel 
and by a sample of teachers who had visited Richmondtown with their 
classes* 

III, PROGRAM IMPLEMINTATION 
The Richmondtowri Restoration Evaluation Pi^ojQct was fully imple- 
mented. Records available in the Coordinator's office indicated that 
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most of the visits which had heen scheduled during the year had been 
made. The exceptions were not the fault of the project hut were usually 
beeauge of transportation or scheduling problems on the part of schools. 

Project policy required that requests to visit Richmondto^m be imde 
in writing. Written conflmation of dates was provided by the Coordinator* 

Visiting groups were limited In size to sixty children, and a supervisory 
adult was required to be present for every fifteen children* ^terials 
were mailed to the classes prior to the visit. These included a descrip- 
tion of tour procedures^ background information concerning the restored 
buildings 5 a reading list, and a vocabulary list. 

Two tours were scheduled each day^ Tuesday through Friday. The 
tows were approxlniately two hoiirs in lengthy and included five bui"Jings 
and four craft demonstrations. Classes were divided into small groups 
for the tour, with a paraprofessional assigned to each group as a guide. 
Different tour routes were followed by the groups in order that rooms 
and demonstrations not be crowded during the presentations. 

Observations were made of a junior high school group and two elem- 
entary school groups during tours of the restoration site. During the 
tours the guides presented information concerning the history of Rich- 
mondtown, and they described the American life styles during the I7th, 
l8th and 19th centuries. Articles on display in buildings were used to 
illustrate the presentations. Demonstrations were provided by a leather 
crafter, potter j printer, and a spinner and weaver. The children demon- 
strated a high interest level throughout the tour, and the paraprofes- 
sionals evidenced a good ability to stimulate and to respond to questions, 
The level at which the material was presented was varied for the differ- 
ent age groups. The teachers of the junior high school group had pro- 
vided a question sheet on which they were to list information. The 
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children were anxious to complete the questions during the tour^ but 
this hindered movement from place to place. The ^ides suggested that 
the forms he completed on a group basis back at the school or during 
the return trip. 

The evaluators asked several children inforinally about^ the class- 
room work which had taken place prior to the visits, and which would 
take place afterwards. It appeared that two of the classes were presently 
involved in units related to American history from this period and that 
lessons were to continue after the trip* 

Project personnel were asked to rate the quality of various aspects 
of the program, A summary of their ratings is presented in Table 1* 

Table 1 

Ratings by Prograjn Personnel' of Various Aspects 
of the Richmond town Restoration Education Project 





Areas 




Mean 


S.D 


1. 


Suitability of physical facilitias 


8 


kM 


.kQ 


2. 


SuitaTDilifcy of available materials 


9 


k.36 


.50 


3. 


Availability of materials 


9 


k.36 


.50 


■ k. 


Sufficiency of materials 


9 


k.kk 


.68 


3. 


Suitability of available eq.ulpment 


9 


k.m 


M 


6. 


Availability of equipment 


9 


k.n 


.42 


7. 


Sufficiency of equipment 


9 


k.kk 


.68 


8. 


Supportive services provided by 
administrative personnel 


7 


3.00 


.00 


9. 


Training provided 


8 


5.00 


.00 


10. 


Positive effect on pupil learning 


8 


k.l3 


M 




Note: The following scale was utilized 
5=Excellentj U^Yery Good; 3=Fair; 


in the rt 
2=Poor' 


iting process 
l=Very Poor, 
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Ratings aaeigned by the RichmondteTO personnel were quite high* 
The staff recognised that the restoration proeesi was still in progress^ 
but felt that existing facllitieg were excellent to aGeompllsh project 
objectives* Ijq^ajided rest facilities and aJi area where children might 
eat lunch were indicated as needs to be met in the development plans for 
Richmondtowi, Materials and equipment were rated very high as well. 
Personnel were unanimous in rating supportive services of administrative 
personnel, the Coordinator^ as excellent'. A similar rating was assigned 
to training provided to personnel* While the staff had contact with 
children for only a two hour period ^ It was felt that they should be 
asked to evaluate t^e degree to which they perceived pupils to learn 
from the town. Given this time limitation ^ It was found that the staff 
assigned a very high rating to the extent to which the visit had a posi- 
tive effect on pupil learning* 

' A questionnaire was mailed to a sample of twenty-five teachers who 
had visited the Rlchmondtown Restoration with their classes* The teachers 
were asked to rate various aspects of the program and to provide infor- 
mation concerning the mariner in which the trip was Integrated Into their 
teaching units* Eighteen teachers submitted completed questionnaires* 
Table 2 provides a siinmary of the teachers* ratings. 
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Table 2 



Teacher Ratings of Various Aspects of the 
Richmondtown Restoration Education Project 





Area 


Excel- 
lent 

5 


* Yery 
Good Fair 

^ 3 


Poor 

2 


Very 
Poor 
1 




1. 


Suitability of physical facilitias 


q 


5 


h 








2. 


Suitability of available materials 


Q 


Q 
0 


1 








3* 


Instruction of guides 


12 


5 


1 










Appropriateness of infomation 


13 , 


5 










5. 


Attention of children during tour 


12 


6 










6. 


Pre-trlp information provided by 
Bichmondtown 


2 


8 , 


5 


2 




1 


7, 


Positive effect on pupils' learning 


9 


9 






it 




8. 


Positive effect of pupils^ behavior 


6 


10 






1 


1 


9. 


Positive. effect on pupils' attitudes 
toward self 


3 


r 


k 




1 


k 


10, 


Positive effect on pupils* attitudes 
toward school 


5 


6 


3 




1 


3 



*iro=NQ response 

The areas directly related to the program were rated as "very good" 
or better by most of the teachers. The only area which the majority of " 
the teachers did not rate as "excellent" was pre-trlp Information. How- 
ever, the majority did rate it as "very good." The one teacher^o had 
rated this particular area as poor provided a comment. It was stated 
that "they used to sand more information." Another stated that "more 
pre-trlp material describing Rtchuiondtown should be provided." 

In the areas related to the program's effect on pupils, the ratings 
were more varied. The difficulty of rating these areas in a prograjn 
which has limited contact with children was recognized by the evaluators, 
Q but it was felt that some data should be obtained. All of the teachers 
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felt that the program had positive effects on learning while the majority 
of teachers felt that it had a positive effect on pupils* "behavior 5 a^d 
their attitudes toTOrd self and school. 

All of the teachers praised the prograjn* They had made visits in 
previous years, A firequent comment was that RichmondtOTn was the "best'* 
of the educational trips they had made with classes* 

The teachers praised the guides for their knowledgeability and for 
the manner in which material was presented. One teacher stated that the 
trip was a "living e^erience in .history - thanks to our wonderful guides*" 
However 5 several teachers indicated that guides occasionally were "too 
rigid" or "impatient" with children who were "excited" by the visit or 
who were "inquisitive and physically active." 

The most commonly cited weakness was the lack of an area to eat 
lunch and the inadequacy of rest facilities for large groups* 

Teachers indicated that they integrated the toip with American 
history units on the bicentennial and colonial times. Emphasis had 
been placed on the Dutch settlement ^ Staten Island history ^ and how man 
survived in colonial times , The inf omation obtained diiring the trip 
was found to be easily related to the units- Teaching activities included 
discussions of the word 1. st provided by the project^ witing stories or 
reports about the tripj discussions of crafts^ explanations of restora- 
tion processes 5 use of filmstrips about colonial times ^ and use of photo- 
graphs taken while on the torn*. Instructional periods directly related 
"to the trip ranged from one hour to four hours prior to the trip and 
from one how^ to eight hoiirs after the trip. 

Several teachers indicated that the trip was used for motivational 
purposes in subject areas other than social studies ^ such as language 
arts and art, , ■ 



rv, PROGRAM EFFECTIVfflESS 

Evalimtion of the effectiveness of an educational prcigrajn which 
provides a treatment or service over a limited period of time is diffi- 
cult. In this particular instance^ the actual period of direct contact 
between program personnel and students ms approximately two hours* Ex^ 
pectations that the program directly increase students' awareness, under = 
standing and knowledge in the stated ^eas must be tempered by this fact* 
In order to achieve the stated objectives ^ the activities of the Project 
must be integrated into the regular instructional progr^. 

The vocabulary test designed for the present evaluation was mailed 
to a s^nple of teachers who were scheduled to visit Richmondtown in the 
late spring. Teachers were to administer the pre-test prior to any in- 
struction directly related to the trip, Post-tests were mailed to the 
teachers the week of the trip. They were to be administered after all 
post-trip instruction had occwred. Classes sampled included grades 
two through six. Children's performance on the pre- and post-tests was 
compared through use of correlateu t tests. Resiilts of the analysis are 
presented, in Table 3* 

Table 3 

Comparison of Pre-Trip arid Post-Trip Vocabulary Test Scores of Children 



Grade 


N 


Pre^ 
Mean 


-test 

SD 


Post- 
Mean 


=test 
SD 


t 


2 


19 


U.32 


2.12 


6.37 


2.50 




3 


68 


5.00 


1.91 


9.38 


3,23 


10.17^ 


k 


h2 


7. Us 


3.17 


11.36 


2.76 




5 


20 


6.50 


1.88 


10.75 


2.81 


6,87-^ 


6 


18 


10,50 


2.19 


12.06 


3. 36 


1.81 


**p < 


.01 
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Statistically significant gains in vocabulary related to the Rich- 
mondto™ tour were attained by children in grades two throi^h five. The 
difference between the two administrations of the test for the sixth 
grade group was not statistically significant ^ but it should be noted 
that there was a gain and the group had the highest pre- and post-test 
means, 

V, fROGRAM STOENGTHS AND WEAMESSES 

The Richmondtown Restoration provides an excellent setting in which 
children come into contact with history. For example^ children sit on 
the benches of the Voorlezer's House and discuss how children were edu- 
cated during the seventeenth and eighteenth centuries. 

The coordinator and the paraprofessional staff were dedicated to 
the project. The compatibility between their personal interests and 
their work in the Project was obvious. Their service to the program ex- 
tended beyond the hours which they are assigned to work. The parapro- 
fessionals were well trained and detnonstrated e^^ertise in the content 
areas covered in the I^oject. 

Another program strength was the flexibility provided. Range and 
scope of information provided by guides varied according to the grade 
level of the children. In addition ^ schools could designate special in- 
terest areas they wish to be covered during their visit. 

One weakness of the program was found to be the manner of instruc- 
tion in a few of the crafts areas. One teacher stated that the "skilled 
persons.,, should assume a lack of knowledge on the part of children^" 
and recommended that the tools be named and be displayed as they are 
being used. The evaluators in their visits found that the printing and 
spinning and weaving' demonstrations did utilize the recommended methodologies 
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The lack of lunch facilities and adequate res',^. faoillties are a 
weakness. It should be noted that program personnel are aware of the 
prohlem and emphasized this in the prS'-trip information sent to schools ^ 
Plans for futile development of the Restoration include provisions for 
such facilities. 

Because the tour covers a three century period of American history 
in two hours 5 children ms.y become confused by the mix of materials and 
demonstrations , 

VI , RECOWMSNDATIONS 
On the basis of information obtained during site visits and infor^- 
mation obtained from staff and teachers the following recoiranendations 
are made: 

1, The program should be continued. As previously stated^ the 
Richmondtown Restoration provides an excellent setting for the study of 
American history, 

2* Information provided to schools prior to visits should be re- 
viewed* Ratings assigned by teachers to the material were generally low 
particularly in comparison with ratings of other program aspects. The 
importance of pre-trip and post^trip instruction by teachers should be 
emphasized in the material. Teacher guides might be prepared to assist 
in presentation of such instruction. Assistance in preparing these 
nmterlals might be sought from teachers who have visited the site. 
These teachers could share their teaching methods and materials with 
others, 

3. In-service training for the paraprofessionals should be pro- 
vided to assist them in further developing ways to respond to "active'' 
children* 

In-service training for the paraprofessionals who demonstrate 
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the crafts should be provided to Increase the effectiveness of their 
teaching methods , 

5* Efforts should - imde to he more definitive in terms of the 
time periods heing covered in sections of the tour* Kie mix of materia 
ale and information from various periods can "be confusing to children, 

VII, SUI#!AEY 

The Richmondtomi Restoration Education Project was a social studies 
program for New York City school children. The ft'oject^s primary activity 
was to provide children with tours of the restored village during which 
crafts demonstrations were presented and information concerning AmeriGan 

history was provided. The obnectlvea of the program were i (1) to acquaint 
students with coimnunity and other resources which would enrich or extend 
their learning of the role of the individual in community living j and 
(2) to increase students' understanding and appreciation of the American 
heritage , 

Evaluation of the extent to which objectives were achieved was ac- 
complished through pre-trlp and post-trip administration of a test de- 
signed specifically for the project. Site visits were made to ohserve 
prograjn processes ^ to Interview staff and to review program records. 
In addition 5 questionnaires were completed by teachers whose class had 
visited Rlchmondtown, 

Results of the evaluation process indicated that the project had 
achieved the stated objectives. It was found that the project was well 
administered and was staffed by highly competent personnel* Teachers 
presented high praise for the project. 

Several areas where the program might be improved were noted* These 
included the pre-trlp infomatlon provided to schools and in-service 
training of paraprofessionals. 
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INTRODUCTION 

The Parent-Child Orientation Program^ conducted dnrj.r'g the summer 
of 1974 at P.S* 289p was intended to raise the reading m ■ , mathematics 
performance levels of forty children. The prograjn was designed to ser= 
vice children who had been retained in foiirth or fifth grade because of 
low reading scores. Staffing for the progrrai was to include a coordina- 
-tor, a reading teacher^ a mathematics teacher^ three family assistants^ 
two educational assistants ^ and a student aide* The coordinator was to 
be responsible for all administrative responsibilities, including planning 
program activities, staffing the program^ supervising personnel^ prepar- 
ing budgets 5 maintaining records 5 and identifying, recruiting and selec- 
ting target children. The two teachers, mth the aid of the educational 
assistants, were to provide classroom instruction in reading and mathem= 
atics. The family workers were to participate in parent workshops, visit 
homes. Identify special fajnily needs and accOTipany parents on visits to 
public and private agencies, A student aide, who was to be responsible 
for clerical work, was not hired. 



II. OBJECTIVES pm mAmkTim design 

The primary program objective, as described in the proposal ^ 
to raise the levels of perfonnajice in reading and mathematics of those 
children who participated in the prograin for at least two months. It 
was anticipated that 85% of the participants would return to their regu- 
lar classroom and attain a passing grade sufficient to be prOTioted. 

The following evaluation procedures were employed 1 

(1) Interviews were held with the prograjn coordinator to obtain 
data relative to program activities and outcomes. Program records were 
made available by the coordinator for review by the evaluation staff. 

(2) Interviews were conducted with the reading and mathematics 
teachers and the fMiily assistants who worked in the sumer program. 
The purpose of the Interviews was to obtain information concerning the 
staff members' involvement in the program's activities and their per- 
ceptions of the program's outcomes. 

(3) Participating children's scores on the Spring, igyh city-wide 
Metropolitan Achievement Tests were to be provided by the coordinator 
and were to be used to ascertain the degree to which the participating 
children were in need of treatment in the summer program. While the 
original prograjn proposal specified that pre- and post= tests would be 
administered, no post ^treatment tests were administered by program per- 
sonnel. Pre-test data were not available at the time the evaluation was 
performed. As an alternative, teacher records of children's progress 
were analyzed In order to identify specific areas in which children 
made gains in reading and mathematics. 

(k) Thm coordinator was also to provide Information concerning the 
numbers of ohild^en who had returned to their schools and who had attained 
a passing grade sufficient to be promoted^ but these data were not avail-^ 
able . 
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III. PROGRMI H^mffiNTATION 
Information concerning prograjn implementation presented in this re- 
port was obtained from interviews with the program coordinator and the 
available staff, and a review of prograjn records. 

Approval for the funding of the prograjn was obtairied in June, 197k. 
Difficulties were experienced in identifying and recruiting children. 
Program staff were able to obtain the names and addresses of potential 
participants during the final week of the regular school year. The 
coordinator stated that two nmilings made to parents resulted in thirty 
affirmative responses prior to the start of classes. He indicated that 
enrollinent continued during the first week of the prograjn and finally 
reached a total of forty-one. It was reported that after four children 
withdrew fron the program early in the summer, enrollment remained con- 
stant at 37. A list of the participants' names was provided. 

Attendance records were made available to the evaluators. The 
children had been divided into four groups for inBtructional purposes, 
and twenty-six separate names were listed. The number of days attended 
for each child, and the average attendance rates are presented in Table 1. 

Table 1 

Parent-Child Orientation Program: Attendance 



Group Participants Days of Attendance Group Average 



I A 27 

(N=6) B 26 

C 27 

D 27 

E 22 



26 25.8 days 



^so- 



Table 1 (cont. ) 



Group 



Participajit 



Days of Attendance 



Group Average 



II 
(N^IO) 



III 
(N-5) 



IV 



A 




B 


25 


C 


20 




OR 


ill 




£ 


25 


\3 






2d 


I 


25 


J 


17 


A 


27 


B 


25 


C 


25 


D 


22 


E 


25 


A 


22 


B 


22 


C 


16 




16 


E 


21 



22.6 days 



days 



iS.h days 
Total Average 23.1 days 



Two sessions were conducted Monday through Thursday^ with the chil- 
dren equall3^ divided hetween the morning and afternoon sessions. On the 
six Fridays 5 all children attended and were taken on trips. All members 
of the staff accompanied the children ^ and parents frequently participated, 
me trips included visits to the Brooklyn Children's Museum^ a Yankee game 
at Shea Stadiumj Queens Hall of Science ^ Coney Island , the Brooklyn 
Botanical Gardens ^ and the Public Library. 

The ^oject staff was asked to complete a questionnaire concerning 
various aspects of the programs. Responses were obtained from the coor- 
dinator , the two teachers and the three Fajnily assistants- Hie resu^lting 
data ar- presented in Table 2. 
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Table 2 

Parent-Chil' Di'ientation Program - Projaet Personnel Survey 



Statements ^ean Rating^ 

(N=6) 



1, 


Suitability of pl^sical facilities 




h3 


s. 


Suitability of available materials 




3.3 


3. 


Availability of materials 




2*7 


U. 

5. 


Sufficiency of materials 
Suitability of available equipment 




2.3 
3-3 


6. 


Availability of equipment 




2 8 


7. 


Suffieiency of equipment 






8. 


Stipportive services provided by administrative 
personnel 


4.0 


9. 


Training provided 






10. 


Assistance of paraprof essionals 




k.3 


11. 


Positive effect on pupils' learning 




h.l 


12. 


Positive effect on pupils' behavior 




3.8 


13. 


Positive effect on pupils* attitudes toward 


self 


3.8 


lU. 


Positive effect on pupils' attitudes toward 


school 


k.o 



^^Response Scale- 5^Excellent; 4^Very Good; 3=Fair; 2^Poor| 
l^Very Poor 

^Two respondents indicated this item to be inapplicable. 

For purposes of discussion^ a mean rating above 3,5 was considered 
to be "good," below 2,5^ "poor 5" and between 2,5 and 3.5, "fair." The 
respondents felt that the physical facilities were good, but the avail- 
ability and sufficiency of equipment and materials were found to be fair 
or poor. The la,tter point was supported by comments of the staff during 
interviews. Because of late program approval^ materials could not be 
ordered far enough in advance to be available at the start of the program, 
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The reading teacher borrOTed equipment and materials from the school where 
he regularly teaches. Pencils ^ paper, stencils ^ related supplies had 
to be borrowed from regular school progrM materials. 

The supportive services of the administrative staff and the assis- 
tance of paraprofesslonals were rated as good. While no traliiing was 
provided for the teaching staffs the Family assistants rated their train- 
ing as very good , 

With respect to the perceived mpact of the program on participating 
children 3 the meaji ratings were in the good range for all four statements. 
Positive effects were perceived to have occiirred on pupils- learning and 
behavior and on their attitudes toward school and themselves* 

Teachers and paraprof essionals were hampered in their work because 
of the lack of equipment, ^terials and equipment which had been ordered 
were not received while the program was In operation. Fortunately^ the 
reading teacher, who had taught In P.S. 289 during the regular school 
year, was able to utilize this school's equipment. Diagnostic tests 
were not available , nor were appropriate achievement tests. The teachers 
devised tests to identify children's strengths and weaknesses, niere 
was one tape recorder listening center, but this equipment was stolen 
during the simmer and replacement was not possible. The problem of the 
late ordering of materials and the failure to receive equipment and 
supplies was a serious one. A flM ordered for use in the Brnmer program 
was received in October. Children had no pencils so the family workers 
purchased them for the children. Paper supplies were never received. 
Rather than cancel the trips which had been instrumental In stimulating 
and maintaining children -s interest, the staff paid transportation costs 
and obtained free or reduced admission from the places visited whenever 
possible. 



=33- 



Parent involvement and interest was a central program focui. ^ree 
parent workshops were held during the sumer. One workshop was held in 
the evening. Attendance at the workshops was reported to be '-fair." All 
of the staff participated in the workshops which stressed the need for 
cooperation of parents with teachers and children. In addition, teach- 
ers were required to schedule at least 15 minutes each day for consulta^ 
tion with parents. The coordinator noted that parents fretuentl^ took 
advantage of this time by visiting teacher h to ask questions, 

IV. PROGRAM EFFECTIVENESS 

Springy 197^+ Metropolitan Achievement Test scores of participating 
children 5 and the numbers of children who had been promoted wh.?n they 
returned to school were not available, TeaciiOT records ehild_ren's 
progress in reading and mathematics were provided for 26 pai-ticiDants. 

These records were content analyzed in order to .InBublfy specific 
areas in which children made gains in the two 3^i> jacit aieas. The teachers 
did not complete checklists , but rither wrote descriptive sentences about 
the children. Furthermore ^ records were not available for aJJ of the 
children. Therefore the frequencies cannot be interpreted in 7^'rc^3S of 
percentages of target population children who improved in reading and 
mathematics. These were the only data available concerning chiluren's 
progress , ^ 

Tables 3 through 6 present a sunmiary of the analyses of the teachers' 
coniments. 
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Table 3 

Parent-Child tolentation Program - Student Development in Reading 



Students' Development Has Sho™ Improvement Has Difficulty 
^^®s,s Group Group 

I II III IV T I II III IV T 



Inferential blinking 


2 


3 


1 


1 


7 


2 


0 


2 


0 


k 


Phonics 


5 


0 


3 


2 


10 


1 


2 


2 


0 


5 


Comprehension 


5 


1 


2 


2 


10 


1 


2 


2 


0 


5 


Decoding 


2 


1 


2 


3 


8 


1 


1 


1 


0 


3 


Syllabication 


0 


1 


0 


0 


1 


a 


2 


1 


0 


5 


Vocabiilary 


0 


2 


0 


1 


3 


1 


1 


2 


0 


k 



Table k 

Parent-Child tolentatlon Program - Reading Teacher Comnents 



The Student: Group 

I II III IV T 



Shows interest In reading 


2 


0 


■ 3 


1 


6 


Has the ability to work Independently 


2 


3 


3 


3 


11 


Needs Individual attention 


If 


0 


2 


1 


7 


Has the ability to work in small groups 


1 


1 


k 


k 


10 


Has the ability to grasp new concepts 


0 


3 


2 


3 


.8 


Has poor work-study habits 


1 


0 


1 


k 


6 


Has a limited attention span 


If 


0 


2 


1 


7 


Is self -motivated 


2 


2 


a 


3 


9 


Weeds reinforcement from home 


2 


1 


5 


1 


9 
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Table 5 

Parent-Child Orientation Program - Student Development in Mathematic 



Students' Development Has Shown Improvement Has Difficulty 

Areas Group Group " " 

I II III IV T I II III IV T 



Addition 


1 


9 


3 


k 


17 


3 


1 


2 


0 


6 


Subtraction 


2 


8 


2 


k 


16 


3 


a 


3 


0 


8 


Mult ipl i cat ion 


1 


5 


1 


1 


8 


k 


5 


k 


3 


16 


Division 


0 


1 


0 


0 


1 


1 


k 


3 


2 


10 


Roman Numerals 


1 


6 


0 


1 


8 


3 


- 1 


2 


2 


8 


Fractions 


1 


6 


0 


1 


8 


3 


1 


2 


2 


8 



Table 6 

Parent^Child Orientation Program - Mathejimtics Teachers^ Comment 



The Student: Group 

I II III IV T 



Shows Interest in mathematics 


3 


5 


1 


1 


10 


Has the ahility to work independently 


2 


7 


0 


1 


10 


Needs indlyidual attention 


5 


k 


5 


3" 


17 


Has the ability to work in small groups 


0 


7 


0 


1 


8 


Has difficulty in grasping new concepts 


3 


' 2 


k 


3 


12 


Has poor work-study habits 


3 


3 


k 


a 


12 


Has a Imlted attention span 


3 


2 


n 


0 


7 


Is self -motivated 


2 


6 


0 


1 


9 


Needs reinforcement from home 


k 


3 


5 


3 


15 
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As can "be seen in Tables 3 3$ ^ number of children improved in 
basic reading and mathematics skill areas. Of the chiltoen for whom 
data were available ^ U6 per cent ihcwed improvement In the areas of 
phonics and comprehension* In the mathematics development areas ^ 65 
per cent showed improvement in additions and 62 per cent in iubtraction. 
It should be noted that the mathematics teacher indicated that large 
numbers of children had difficulty with multiplication and division^ 
62 and 38 per centj respectively.. 

Tables h and 6 present a summary of the two teachers * coiments con- 
cerning work and study habits of the children. It should be emphasiaed 
that the comnents were not indended to indicate progress ^ but were in-- 
tended for use by the children's regularly assigned teachers. The prob- 
lem areas were ones which would be expected to occur. The mathematics 
teacher Indicated that 65 per cent need individual attention 5 50 per 
cent need reinforcement from home^ and ^3 per cent had difficulty In 
grasping new concepts and have poor work-study habits. The reading 
teacher's responses were more favorable than those of the mathematics 
teacher: 27 per cent were noted to need individual attention^ 23 per 
cent had poor work study habits 5 and 27 per cent had a Idjnited atten- 
tion span. 

Conclusions concerning the prograjnfi's eff activeness must be extremely 
limited. No "hard data" exists to support definitive statements. It 
appears 5 on the basis of teachers^ coimnents regarding children's progress 
and the data obtained in Interviews with progrra personnelg that chilr ^en 
benefitted from the program. 
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V, raOG^4 SIRMGTHS MB "WMmiSSES 
-It is extremely, difficult to asses itrengths mA weataeSBas of a 
program on an ex-poit-facto basis. Strong reliance must be placed on 
Information olDtained from Interviews conducted with program personnel^ 
rather than on observation of program processes. However ^ ready access 
to prop*am records ^ which could be used to docment the Interview data^ 
ms provided. 

late approval of the progrMi prevented systematic cooperation between 
schools and the program with respect to identifying and recruiting chil- 
dren in need of assistajnce in reading and mathematics. While the speci- 
fied number of target population children was eventually obtainedj infor- 
mation from the children's school records was not readily available. 
Spring 197^ MkT test results ^ which were to be used for placement pw- 
poses and for the pre=test scores for evaluation, were not available. In 
most cases* The failure to provide funds which had been specified in 
the prograjn budget seriously handicapped program personnel. The coor- 
dinator reported that materials 3 such as paper and pencils ^ had to be 
purchased by program staff. The reading and mathematics teachers obtained 
materials from their regular school assi^ment sites for use in the pro- 
gram. In his report on the sumaer program prepared in August 5 197^, the 
coordinator wote that had it not been for such cooperation "our program 

would have been destined to failure." 

Another serious program weakness was the failure to conduct post- 

testing of program particlp^ts . The coordinator indicated that no funds 

were available to purchase tests ajid that those tests that were available 
were not of the appropriate level. 

The major program strength appeared to be the commitment of the 

staff. . The coordinator managed to obtain support of various ccmmunity 
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agenciei for ieveral of the trips. He also me able to obtain some gup- 
plies ftoiii schools or district officej. Wien other alternatives were 
not possihlej staff contributed monies frmi their own salaries to obtain 
mterial or to pay for public tr^slt costs for trips. 

VI, BlCOMMEroATICNS 
=^~lt-is imperatlYe that sumoaer programs be approved as early as pos- 
sible in the school year. Adequate time for making progrM proposals 
operational must be provided. It appeals that the children who partici-' 
pated in this progrwn were fortunate to receive the services of personnel 
committed to the program. The staff was faced with many obstacles but 
was still able to provide services to children. 

Evaluation of sijjmner programs should be conducted while the program 
is fimctlonlng. Obtaining data concerning program processes is seriously 
limited unless observations are made. In addition^ guidance can be pro- 
vided to program personnel with respect to testing of children. 

Because the prograjn follows a dlagnostic-prescrlptive approach^ ap« 
propriate tests chould be given at the beginning and end of the summer 
program. 
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SCHOOL OF MmCMHON 
INSTITUTE FOR lESEABCH AMD EVAIUATIOIT 



VALUATION OP CITY-WIDE UMBmLLA PR0G1A^© 
raw YORK CITY BOARD OF EDUCATIOIT 
197it-1975 SCHOOL YEAR 
"WALK AND TALK PROGRAM" 
Prepared by: Carolyn N. Hedlejr 

I. Tm PROGRAM 

The intention of the Walk and Talk Program was to provide instruc- 
tion and tutoring to Immigrant children and to children from bilingual 
homes in the subject areas of reading, communications and mathematics. 
It was felt that the tutored children benaflt in terms of their Siglish, 
their reading, their written work, their mathematics and In the subject 
areas for which they were doing home assignments. Much of the tutoring 
was to be done by high school students from the neighborhood area, who 
were to be trained and supervised by the staff. This tutoring -training 
was intended to aid the high school students in their own performance 
in these curricular areas. 

Descriptio n of Program ; The children (grades 3-6) were enrolled 
In an after-school and Saturday program which emphasized not only the 
study skills in the areas of communication, reading and mathematics, 
but gave these students an orientation to the city by providing monthly 
Saturday trips (upon which the study of many of the curriculum skills 
as based) to such places as Radio City Music Hall, the circus and the 
parks, zoos and recreational facilities of Few York City. 
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Seltotlon of Parbiolpants * Particip^ts (gradei 3-6) met the criteria 
of retardation by two years or more in 'basic skills* Priority in degcend- 
ing order was given toi 1) nm or recent immigrant children who spDke a 
language other then English as their primary language | 2) children who 
had "been in the United States for less thwm: two years | 3) children from 
hlllngual homes showing severe retardation in 'basic skills* High school 
students were selected on the 'basis of: 1) hlllnguri Imguage ahlllty^ 
and 2) interest in tutoring children. 

The progrML was a year-round program^ running through the simimer 
months as well as the school year* The school (P.S, 2-M) w^ a focal 
point in this lower East Side Manhattan community and thus it was a 
natural center from which to implement such a program* 

PopT3j-ation Served : The program was structured to serve approximately 
90 children of elementary school age and approximately 20 children of high 

school age- _ 

II, EVALUATIVE PROCEroRES 

Inasmuch as the summer program had terminated by the time the 
evaluation had begun ^ it was necessary to assess the suiiMer progrMa by 
use of a questionnaire* (Fortunately^ most of the personnel in the 
program were teachers or aides in P.S, 2-M and were therefore avails- 
able for interviews-) A questionnaira was developed and used for eval« 
uatlon of the siamner program component of the Walk and Talk Program as 
well as for the program which ^mctioned durljig the school year. The 
identical staff for the program did not fraction year around due to a 
ruling by the board of Education regarding a salary maximum which could 
be earned by the director and the teachers in the New York Public Schools* 
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questigmaire : The questlormalre was developed after preliminary 
visitation in order to ascertain which areas shoiad be oovered in such 
an instrument. The questionnaire provided for an mtsniive survey for 
the evaluative director to perform on each class ^ as well as an inter- 
view form for the director ^ the teachers^ the teacher aides ^ the student 
aides and the children who participated in the program, 

Tests ; The evaluation design from the Board of Education called 
for pre and post tests (Stanford Aohievement Test Battery) to "be ad- 
ministered to ill of the children in the program^ including the high 
school aides. The test used was the Stanford AGhievement Test in 
Heading^ Mathematics and Auditor Skills. The pretest was adminis- 
tered as directed and the scores were recorded and reported to the 
evaluator , 

Evaluation Forms i ilnal Infomal evaluation was done by means of 
an evaluation form^ which was administered to all participants in the 
program - the director^ the teachers ^ the teaching assistants ^ the 
student tutors and the students themselves. 

Ill, FiroOTGS 

The effectiveness of the program was detemined through visitation 
by the evaluator and through Interview of program personnel^ through 
statistical analysis of scores on the Stanford Achievement Tests^ and 
through analysis of responses to questionnaires administered to the per- 
sons in the program, A cursoi:^ view of pretest scores revealed that 
many of the children were unable to read in English at all due to the 
fact that over two«thirds of them had been in this countiy less than a 
year. One class in which much Chinese was spoken was in* effect ^ a TESOL 
program. Another class was taoaght in which translation was done. The 
third class is InstruGted mostly in English^ since the students have 
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acquired the mdimenti of the aiglish lanfuaga. 

Analysis of StandErdl^ed Test Scorts i An^ysis of stMdardlzed teit 
scores on the Stanford AchiOTement Testi (SAT) with subtests In Audltoiy . 
Comprehension J Mathematical Computations ^ and Mathematical Applleatlons 
revealed no single pattern of significant Improvement among the students - 
from grades 3 to 6 (Table 1). Much of this lack of slgnlflQance cm "be 
attributed to the very small number of the children to whom complete pre-* 
and post --t est i were administered. In all^ there were, over 170 children 
(counting those in summer school^ many of whom went on to the Junior 
High School and were never tested) who were In the program* There was 
a very high trmslency rate in the school In that many of the children 
move during the school year* Kierefore^ both the pre- and past-testi were 
not administered to a large number of the children who received program services. 

Over two-thirds of the children in the program had been in the 
country fbr less than a year. (Ml of the Level II children felf in- 
to this category and mmy of the Level III children had been In the 
United States for less than a year, ) These non-aigllsh spewing students spoke 
Chinese^ Spmish or French* they did not take the New York City Read-* 
Ing Test due to the fact that they were non-Bngllsh spewing. Al- 
though the director had attempted to control testing procedures ^ and 
the test -givers had attempted to 'help the children take the tests by 
reading some items aloud ^ the children foimd It Impossible to take the 
test. Of the 170 children in the program^ complete scores on the pre« 
and post-tests were available for less than gO children* Approklmately 
one-fourth of the sample was measured by mems of the SAT. The small 
ntunber In the sample reduced the likelihood that the children would In- 
dicate significant gains in test res"ults. However^ the obtained resets 
shoiad not be Interpreted to mean that the pre ;ram was less than success- 
fHjl. Other methods were used to arrive at the outcomes of the Walk and 
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Analysis of Stanford Achi^ament Ter Scores 





Grade & Test 


N 


Pre-T 


SD 


Post-T 


SD 


t 






Mean 




Mean 







Grade 3 (ill) 














• Audi"borv ComD 


J 


o nn 




2.00 


Qf-i 
.09 

.it5 


1.7it 


* Reading Comp* 


k 


2.50 


.22 


3.it5 


It, 55* 


.MatH Comp* 


■ k 


2.90 


.82 


it. 38 


.56 
.73 


9.97** 


#Math App. 


k 


2.95 


.it3 


3.18 


l.Oit 


Grade k (ill) 














- And 1 "fc □ t*V Hnrnn 


( 




• ?o 


2,10 


1.17 


1.15 


, Reading 


5 


2.28 


.70 


2.98 


.69 


3.61* 


,Math Comp* 


7 


k.OO 


l.6d 


5.23 


l.llt 


1.86 


*Math App, 


11 


3.07 


.96 


3.11 


1.20 


.lit 


Grade 5 (ill) 














* Auditory Comp* 


10 


2.39 


.6it 


3.57 


1.95 


2.26* 


•Reading Comp* 




3.98 


1.23 


it. 73 


1.90 


1.00 


•Math Comp. . 


7 


5.19 


2.00 


6.04 


.53 




,Matli App, 




it. 65 


1.73 


it. 25 


1.71 


J..it9 


Grade 6 (ll) 














, Auditory Comp* 


6 


1.35 


.63 


1.55 


.50 


.63 


* Reading Comp* 


6 


1.55 


.23 


2.27 


.itO 


6.07** 


^*Math Comp. 


6 


it. 58 


.63 


3.98 


.79 


-it. 38** 


.Math App. 


6 


2.75 


.79 


it. 25 


.67 


3. its* 


Grade 6 (ill) 














*Audltoiy Comp. 


15 


2.6o 


l.ld; 


2.88 


i.n 


.8it 


.Reading Comp. 


15 


3.65 


1.13 


It.itl 


1.50 


3.02** 


*Math Comp. 


15 


6.25 


.91 


6.67 


1.01 . 


1.91 


.Math App. 


17 


it. 68 


1.26 ■ 


5.62 


1.39 


k.ks ** 



^Sipiificmt at the .03 level NOTEf Negative t values IndiGate that 

■^Significant at the .01 level posttest means were less than 

pretest means. 

NB Grade 5 had only one child with pre and post test scores for all 
four subtests 5 one with data for two suhtestsi therefore no 
analysis could be imdertaken. 

Grade 3 (ll) had only two children with complete data; no analysis. 

Grade k (ll) had only two children with complete scores and sub- 
tests | no analysis. 



Qyade 5 (ll) had only one child with complete scoresi no analysis. 
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Talk Prograin* 

Attendance I Throughout the year^ when observers visited the program 
it was noted that over 93% of the children enrolled were in attendance. In 
like manner^ the high school tutors were also dedlGated to the programi 
they were paid only $2*00 an hour for one and one-half hours per da^^ yet 
were present for their responsibilities ^ which they fulfilled conscien- 
tiously* 

Reaction of the Teachers: ^ utilizing the Information gained from 
all of the teachers in the program through questionnaires^ interviews 
End observations, it was evident that the reaction of the teachers was 
positive toward the program. The children were deYeloping the skills; 
they were gaining in a Imowledge of the city and the culture in which 
they lived J and they were able to respond to tutoring on a small group 
basis in the subject areas and with their school assigned home work. 
Without this program, the children in the program would not get help 
with their homework and with their English^ which would be an Irreparable 
set-back to the acculturation process, Mar^ of their parents work^ so 
the prograin also provides supewision for the immigrant bilingual child. 
It was noted by the evaluator that even the most Inclement weather did 
not keep these children from arriving at their classes. 

According to the evaluation questionnaire filled out by all of the 
teachers and the director of the program, the trips were- a basic part of 
the programi teachers would like to have more field trips^ more materials, 
more help with spoken English, more classrooms and more teachers with 
smaller numbers of children. Substitutes should be provided by the pro- 
gr^ when teachers are ill. Teachers felt that tutors should ^ be 
dropped if they lack social or academic skills. In general, 
the comments suggested not that the program shoiad be substantially 
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ch^aa, tut that it shoid.d provide mort of the turiltative funetions 
that It was alrta^ proTiding, 

Reaction of the laacher Aides ; The reaction of the teacher addai 
was also positive. Maj^ of the SMie comB^nti that were made by the 
teaohers were echoed ty the teaoher aides ^ who in large part were f^om 
the Goramunlty* The aides concentrated on giving individual help and 
on keeping the program varied and appllcahla to the neledi of the child- 
ran. The teacher aides ( coimmnlty connected adults ) appeared to he 
socially close to the children md very much appreciated by the stu- 
dents in terms of "seeing someone that th^ know," ^om their res- 
ponses to the questionnaires J the teacher aides appeared to be tulte 
able and conscientious. This same comment was made "by the director 
of the progr^ i^d the teachers 5 as well as by the students in the 
program. Several of the aides were concerned about the lack of sup- 
plies for the prograin, others felt that some snack afber-school would 
be a positive contribution to the program* S^eraliof the teacher 
aides said that If the program should be discontinued^ It would have - 
devaatating effects upon the acculturation of the children in the 
community. Their sentiment was echoed by mmy of the coimnunity leaders 
and parents who were often present when the evaluator of the program 
appeared. All of these "outside" persons appeared to be veiy suppor- 
tive of the progrm^ both by their presence and by their comments. 

Reaction of the Student ^tors i The high school students made a 
ve^ poeitlve contribution to the program. These seventeen students 
appeared on the Job and were never observed to be less than dedicated 
to the elementary youngsters in the program. The high school students 
provided a strong continuity of the program to the comraunltyi more- 
over they provided strong^ interested and positive role-models to the 



50 



newly arrived imigrant youngiter who mi the focal student in the progrem. 
The maturity and dediGation of many of these older students was extraordinary 
For axan^lej fourteen of the seventeen tutors answered the questionnaire 
fully; the three who did not had no opportunity to do so* Again ^ the 
study skills and the poise exhibited by the answers to these questions 
were quite professional. The high school students also exhibited a great 
deal of originality and resoweefulness in their work with the students | 
for instance 5 in answer to the question as to how to improve the program 
for next year 5 the answers were "I would like to have more materials," 
"I would like to help the children in areas other than reading ajid 
writing," "I would like to have a longer time with the students in order 
to teach them with their reading," "I would like to have more time to 
get to know the materials better," "I would like to have more recent 
materials," 

Toward t^ .end of^ the prograjn (final evaluation forms were given 



out during mi^*une) there appeared to be a deteriorating relationship 
between some of the tutors and some of the teacher.^. Whatever seemed 
to cause this rift should be avoided in the future, or should be 
systematically alleviated* High school students felt they should receive 
more pay* It also seems that, in some ins^tances, they should be qualified 
academically and socially to tutor children* On the other hand, it is 
possible that teachers 5 who are accustomed to working with either adults 
or yoimg children^ should be apprised of some of the social and psycho- 
logical needs of high school youth. For the better part of the prograjn 
however, these high school student -tutors made a significant contribution 
to the studies, English- speaking abilities and the social needs of the 
yoimger children in the prograjn. 

The high school tutors would like to have more trips, more games, 
more class participation, more teacher planning with the staff, cul- 
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tural progrms ixi bot,h SngliBh and Spanish and more claairoomi utilized 
with smsiler ^tc'x^ of children within smaller clasies. They woaild also 
like to be better paid. 

Reaction of the Students f Whatever the sentiments of the other par* 
tlelpants in the programi the stadentsj especially those who were able 
to write by the end of t} d p ogrm, were meq^ulYocally enthuaiaitle* 
Unanimously^ they wanted mo.v^ fleM tripi which they enjoyed vexy iiruchi 
thay were fond of their ti/:,ors for the most part| they liked their 
teachers 5 the progr^ its^iv-. ? and the help with their home work, How^ 
ever, many, maj^ of the viants expressed strong negative feelings 
conGernlng the heav^^ testLL^Jii c^ompment of the program* 

Itost of the students we:r not yet able to mswer ^estlonnalres to 
English, Therefore, in some cases tiie questioraiaires were adminlBtered 
orally, while the teacher or an aide trangcribed their answer on a papers 
Even taking Into accoimt that the comments were screened thro^h an in- 
tervlewer^ the children's attitude was respectful md appreciative. 
Many of the Chinese children in the program were recently from Hong 
Kong or Taiwan and ftom families who were seeking an opportunity 
for themselves and their children. The Spanish speaking 
youngsters were often from Central and Scuth ^erlca. Their families 
also were hoping to become pemanent reoidents, and they plaeed high 
priority upon literacy and educational needs* Although the children were 
very new to the city, they were aware of the dedication of the personnel 
in the program and responded to this sentiment. Some said that personnel 
in the program helped them not only in the school, but had given finan- 
cial aid and soGial advice to the family. All of the children mentioned 
over and over again how much they liked the trips, especially to the 
Music Hall and to the Circus* These trips seemed to be a highlight in 
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a rather circiMicribad '^istenae. from these tkps^ they ware able 
to help their parents negotiate the suhways in order to travel about 
Ma^attan. All of them^ without exception, said that th^ wmted 
to he in" the program mxt year. 

ThB Walk and Talk K-ogrM haa functioned In a highly effective 
manner for several years. Even with the lifted data collected here, 
it is clear the progr^ is working vexy well and should be continued 
for the benefit that It brings to the childr^. However, the follow- 
ing areaa should be Gonsldered for possible iterations 

1. Held trl^ ; More field trips should be made available to 
the program, since the children seem to benefit from them. 

2. Materials t There should be more materials , in tems of paper 
and pencils, ^ trade books, specie materials^ for helping in a TESOL 
program, more ditto work, md more reference mterlals J' . These ^ ^ ^ = 
materials should be delivered promptly or ordered the year previous 
to the program* s funding in order for the progr^ to be inaugurated 
effective^ and without cost to the school, 

3. Testing : The testing progrM is highly inappropriate and a 
aource of anxiety ^.and irritation to the children and to their tutors 
md teachers. Although testing mst be done. If the children were ' 
given a simple short test oh the ASPIRA model in reading, and a 
language fluency test^ It would probably tend to measure reasonable 
progress In these areas. Unfortunately these materials have not been 
developed to ai^ great degree in the Chinese Imguage and/or the 
Spanish language for immigrant children. The present testing deyiaes 
are far beyond the language abilities of the yomigsttre in the pro- 
gram and are nearl^r useless for the populationi however it is difflc^t 
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to preicrlbe a iolution to a very real pi^blem in the program. 

^* Progr^ E^pbnilon : Inasmuch as the progr^ is designed to help 
children with baaic learning skills , it should be CTpmded to the first 
and second gr^e children in the ichool alio, Not only should the lower 
grades be included^ the classes which nuj^sr 30 should be sm^ler md 
the withinK^laas groups sho-uld not be more than four persons to a tutorj 
so that children can hOT-e greater convarsatlonri opporfcmities as 
well as more Individu^ attention* Children with learning disabilities 
should be added to the program^ with an ^en smriler adult-student rati© 
than Is now standard in the bilingual classroom. 

5' ItodiYiduallEat ion t Papil progress should be measured informally 
and more Individually prescribed instruction shoTj^d be undertaken In 
the basic skills. Progress charts and checmsts might be used* 

6* Program Content and Scheduling : If refreshments could be pro- 
vided, the students woi^d probably be eontM.t to stay in the program 
longer than the present closing time. At the end of the school d^^ 
juice 5 milk or cookies would enable the students to participate more 
effectively for a longer period of time in the Walk md Talk Programj 
An extension of time would allow for an E.S.L, component to be added to 
the programi the children should remain for two hours instead of m 
hour and a half, 

?• Funding : The Board of Education should promptly process and 
pay the salaries of personnel in its Umbrella Programs, me $2,00 per 
hour salary rate for tutor which is the current rate established by 

the New York City Board of Education, should be reviewed. 
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I, 



INTRODUCTION 



This program consisted of two separate components 5 but had as Its 
goal the "improvement of reading skills for those children who consistently 
failed to maintain their grade levels." One component (The Future Teachers) 
was designed to attack this problem dlreotly through two weekly'^ one-hour^ 
after-school tutorial classes* The other approached the problem indirectly 
through a re-trainlng prograrn for both new and experienced teachers. Six- 
teen elementary and five Junior high schools of school districti 18 and 23 
were involved in both components, 

II. PROGRAM EVALUATION 
The children who were the identifiable recipients of the benefits 
of the tutorial program served as subjects in a pre- and post-program 
measurement of reading skills. Results of the Spring 197^ and the Spring 
1975 New York City testing program were utilized as the bases for statis- 
tical analyses. Comparisons between pre-test and post-test results were 
made utilizing historical regression procedures wherever appropriate* 
Tables imde available by the Office of Educational Evaluation were used to 
convert 1975 tss-^- results to comparaBIe grade equivalent scores on the MAT, 



55 



"51- 

Because of the nature of the Teacher Training Component no "hard 
data'' were available. Interviews with a san^le of teachers in the echools 
involved in the Teachers Training Prograjn^ utilising an interview schedule 
developed for this etudyi were conducted in order to obtain inforniation 
concerning the impact that thig component had on their teaching approaches, 

III. mOGRAM BffiaffiNTATION 
A, Future Teacher s (Tutorial Component ) 

Approximately 550=600 identifiable students were to be served by this 
program. Subjects were recommended by the teachers to the principalj who 
then selected participants. The selection process may be best illustrated 
by one school where the principal reported that he selected participanta 
from ajnong those recommended on the basis of three factors i (1) the par- 
ents gave pemissloni (2) the student was receiving no other funded helpi 
and (3) the student tos only "^somewhat behind" and his chances for improve- 
ment were rated as good , 

The teacher in the tutorial prograjn was a regular . staff member, ajid 
this resulted in effective communication between the prograjn* s staff and 
the child *s regular teacher* Because many parents picked up their chll« 
dren after the tutorial session at kiOQ^ there was an opportunity for 
communication between home and school. 

The tutorial classes met two days per week for one hour^ usually 
fTom 3iOO to ^^00 P*M* A few classes met from 7^30 to 8:30 A,M, in some 
jjunlor high schools. Twenty-one schools (l6 elementary and five Junior 
highs) were served by this program. Eighteen of the schools were located 
in District l8 and three in District 23. Each class in each school con-^ 
sisted of approximately 30 children^ and was staffed by one teacher^ one 
teacher *s aide^ and a maximum of 15 high school seniors from four Brooklyn 
high schooli who were members of their school,' s Future Teachers Club. The 
^ tutors were paid $2,00 per hoiir. 
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B* TeaQher Training CQmponent 

Experienced teachers from 16 elementary schools (13 in District l8 and 
three in District 23) met on a monthly basis , and cooperatively set up 
sample demonstrations of a teaching mathod for a pa^ticiaar aspect of the 
reading prograjn. ^ese meetings generally lasted ih to 2 hours. The six-- 
teen teachers were to return to their respective schools and arrange extra- 
school demonstrations through their principals, and were then to come to 
the next monthly meeting with an evaluation tram the teaching staff in 
their schools of the previous month's demonstration. 

However, there was no identifiable group of children that was a eon- 
tinuing recipient of the benefits of these meetings, since the interaction 
was not systematic and its implementation -mm subject to the influence of 
a variety of factors* 

IV. PROGRAM EFFECTIVEigESS 
A* Future Teachers (Tutorial Component) 

Observations were conducted at ten elementary and three jimlor high 
schools involved in the tutorial program dm^ing the period from May ih 
through June 3. Inspection of Table 1 (p, VI-U) indicates that the 
t:ypical class consisted of foiorteen pupils, ^ somewhat less than half of 
those enrolled. There were six tutws for the fourteen pupils, again 
Something less than half of those involved in the prograjnl The typical 
pupil was a fourth or fifth grade girl, ^ to two years behind in reading, 
and her tj^ical tutor ms also a female. The pupils had been nominated 
by their classroom teacher or the guidance counselor, and parental per- 
mission had been secured for their participation. 

It usually took 10-15 minutes of the allotted hour for the pupils, 
teachers and tutors to arrive and to settle down to work. Once settled 
down^ however, the children and tutors worked earnestly. The usual ac- 
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Table 1 

Sunimary of Observations of Tutorial ProgTm: Attendance, Facilities ^ Proeedm'is and Materials 
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tivity .ms alternate reading aloud by the pupils to the tutors in groupe 
of two or three pupils to one tutor. Rapport between the pupils and the 
tutori seemed good as wag evidenced by a good deal of touching and smilin 
encouragement . Most classes used Reader Digest reading materials. 

The educational assistant seemed, in most classes observed ^to have 
but one function - paper work, Thay general]^ sat in one place aad did 
not move through the class. They recorded the attendance of both the 
pupils and the tutors and occasionally questioned the tutors regarding 
the whereabouts of the absent tutees. Few of them actually worked with 
the children during the classes observed* 

The teachers moved about from group to groups listening and sugges- 
ting once the class began. During the "settling-down" time they assigned 
pupils to tutors when their regular tutor was absent. Occasionally , when 
the pupil^ tutor ratio ims too high, a teacher would work with a group* 
vmen this happened, the difference between a tutor (untrained) and a 
trained teacher was quite apparent - the teacher sought to help the chil- 
dren generaliae while the tutors dealt only with correcting p^ticular 
errors. Although the tutors seemed generally to be brimming over with 
good wills their lack of training was evident* 

Spring 197^ scores on the MAT were used as pre-program measm'es of 
reading levels and Spring I975 scores on the New York City tests were 
used as post-progrM measures* A conversion table was provided by the 
Board of Education to equate the measures, and a predicted post-test 
meaji was computed for each grade utilizing the historical regression 
procedure. The predicted post-means and the observed post^means were 
con^ared, using correlated t tests. The results of these analyses ap- 
pear in Table 2* 
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Table 2 

Summa^ of Prsj Predicted Post^ and Observed Post Program 
Reading Grade Equivalents "by Grade! Tutorial Program 
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Total 280 

^Significant at *05 level 
-^^^Signif leant at .01 level 

Inipection of Table 2 indicates that the children in grades 2, 
5 5 65 and 9 seemed to have shown ^ a statistically significant reading im- 
provement. While participants in grades 3 3 7 and 8 demonstrated gains in 
reading achievement ^ the differences between predicted and observed post- 
test means were not statistically significant over that predicted* It 
should be pointed out, however 5 that the standard deviations at every 
grade level are larger on the post-test seorei thaji they are on either 
the pre- or predicted post scores* Further ^ careful review of the pre- 
test meajis indicates that, excepb for grade 25. children were chosen for 
the prograjn who were Indeed ^ to two years behind in reading. 
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B- Teaoher Training Component 

In an effort to evaluate the Innovative Teaching ^rogTom^ Interviews 
were heia with the progrMi^s Goordlnator and with a randomly choaen ian^le 
of eight teachera in eight different achoola. In addition, curriculum 
mater iali generated by the prograjn were reviewed. The eight teachera 
were aiked the following questions: (1) "Have you ever been involved in 
this program? If the answer is yes, what are your thoughts on It?" Of 
the eight interviewed, two were or had been involved. Of the two, one 
thought the monthly meetings were "boring" and reported that to (her, . 
his) knowledge, the materials developed were not used in (her, his) schcol. 
The reported that the progrRm ims good, that (he, she) had used curriculum 
guides, and that they were available in the school ^s library, and they T^ere 
used by other teachers "on occasion," 

(2) "If you have never been involved In the prograjn, have you ever 
heard of it, used the materials generated by it yourself, or known of any 
teacher that has used these materials?" Four teachers indicated that they 
Lad never used any of the materials themselves. Two did not know any other 
teacher that had used the materials either, but two did know of some who 
had. The remaining two teachers never heard of the program* 

While the results of these interviews are certainly not conclusive, 
they do tend to bear out the concerns of the program*s coordinator, I.e., 
that although the developed curriculum materials could be usefiil, es- 
peaially to beginning teachers, the delivery system for them was weak, 
and dependent upon the interest and enthusiasm of not only the partici- 
pating teacher but also of the individual building principal. It seems 
fair to assume that the number of children who benefitted from this pro- 
gram "ms much less than was desired. 



62 



-57- 



V , RECOMffiNDATIONS 
Ap Future Teacher e (Tutorial Ooprponent) 

Because the program seems instrumental in raising the reading leva! 
of its pa^ticlpanti beyond the level of chance, it should be continued. 
Additional recoimnendations are made on the assumption that it will be 
continued , 

1, Plans to carry out all administrative procedures for tutors at 
one time 5 in one place should be implemented, 

2, Because the interest of teachers, tutors and pupils seems to 
wane once spring testing has been concluded^ consideration should be 
given to holding three weekly classes and ending the program in May. 
This might also minimise the effect of the closing of community canters 
which .jeopardized the program this year, 

3* Because the teachers are trained and the tutors are not, it 
would seem to be more effective if the teachers moved more from gvoup to 
group 5 and the tutors reviewed what the teachers did* The educational 
assistajits could provide more help diirlng the "settling-down" period, 
and return to their paper work while the teachers, pupils, and tutors 
are at work. 

h. Future evaluations might want to study the effect that partici- 
pation has on the tutors, e,g, does their school work or self-esteem improve? 
B, Teacher Training Component 

Unless some steps are taken to improve the efficiency of the delivery 
system for developed curriculum materials, the progrMi should be eliminated* 
These steps might include (a) the recruitment of teacher participajits who 
are demonstrated leaders in their own schools, and who themselves are 
enthusiastic. about it, and (b) the involving of the building principals, 
whose cooperation is essential for the program to function. The principals 
might be involved in the development and circulation of the curriculum 
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This evaluation has described the objectives and implementation of 
a tutorial reading pro-am and an innovative teaching program in District 
18 of New York City. The evaluation consisted of classroom observations, 
interviews 5 and analyieg of pre and post-program reading scores. These 
analyses Indicated that the reading level of the pupils In grades 2, 
5, 6j Bnd 9 who were Involved in the tutorial program seemed to improve 
beyond the level predicted by historical recession. Thus, it Is recom- 
mended that this program be continued, although some suggestions for im- 
provement are made. 

Interview data seemed to corroborate an impression gained through 
discussion and observation that the delivery system for curriculum guides, 
developed in the Innovative teaching prograa^ tos Ineffective. Unless 
this delivery system can be improved, it is recoiranended that the program 
be discontinued. 
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EVALUATION OF CITY -WIDE inffiRELLA raOGRAMS 
NEW YORK CITY BOARD OF mUCATION 
I97U - 1975 SCHOOL YEAR 

"EDUCATION m ACTION" 

Prepared byt Michael L, Berger 

I, INTRODUCTION 

Education in Action 5 formerly known as the School Comaunity Neigh- 
borhood Center, had ae its main goal the development of better miderstan- 
ding of the adverse effecti of venereal dlieasej cancer 5 alcoholism, nar- 
cotics abuse, and other health problems. Students and parents in Coimnunity 
School Districts 3, and 5 were the target group. The Program employed 
a series of films ^ workshops ^ and "rap"" sessions to accomplish its aims* 
These activities were held in the participating schools, usually as part 
of ongoing courses such as hygiene and physical education or parent assoc- 
iation prograj^is. 

For students. Education in Action developed an educational "cycle" 
which was normally sequenced over a period of from four to sIk weeks* The 
same group was esqposed^ in turn, to inforimtion concerning venereal dis- 
ease, cancer, alcohol, and drug education. At the end of the cycle, the 
^ogram staff began anew with another group. It should be noted that the 
Education in Action staff worked simultaneously on several cycles in dlf- 
ferent schools throughout the districts. The adult workshops, which gen- 
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erally resulted from community requests, consisted of single, rnirelated 
sessions. 

Instruction for the student sessions ms normally carried on by the 
Program staff, although the regularly assignea classroom teacher was usu- 
ally present. This latter situation Improved the chances for later fol- 
low-through by the regulM- teacher when the Education in Action presen- 
tations had been conflated. 

The adult workshops were conducted by specialists from cooperating, 
civic agencies, such as local hospitals, blood programs, and medical 
schools. A guest presentation was usually followed by a question and 
answer period. These sessions were normally held in the "family room" 
of the host school and refreshments were provided. 

II. EVALUATION DESIGN 
The evaluation design ^or the Education in Action program was based 
primarily on the results of written questionnaires, which were developed 
initially by the Program staff for each of the content areas. A "pre- 
test" was administered to participants Immediately preceding the activi- 
ties for that session. The same Instrument was then re-administered as 
a "post-test" at the end of the session. In addition, an informal at- 
tempt was made to elicit feedback from adults, students, and cooperating 
teachers regarding the relative worth of each session and of the total 
program. 

While the basic evaluation design remained unchanged throughout the 
year, the questionnaires were substantially modified in the spring. As 
indicated, the original instrmants had been written by the Program staff . 
Since the evaluator was not appointed tmtil mid-winter, it was decided 
to accept the results of these questionnaires for the first half of the 
year, while at the same time studying the instruments for possible revision. 
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Unfortmiatel^^j the original queitlormalres were deemed inadetuatSj 
neceisitatlng the creation of new ones in the spring. Improvements in- 
corporated in the new instruments included ^ (1) an increase in the number 
of queetions to a iinif orm eighteen - there had been from ten to seventeen 
questions on the original instruments ^ with the mean "being eleven* The 
chances of obtaining statistically reliable results were thereby enhanced; 

(2) the reading level and phraseology of the questions were modified to 
minimize lajiguage comprehension difficulties and provide parallel syntax; 

(3) the disproportionate number of times that ''true" was the correct re- 
sponse was rectified by creating a more even "true/false" distribution 
of correct answers; and (k) provision was made to add the classification 
"Do Not Know"" as a possible response to all questions. This effectively 
eliminated the earlier ^'forced -^choice" situations which probably inac- 
curately measured the true content knowledge of the participants* 

As a result of these changes in the mitten instruments 5 two dif- 
ferent t3^es of inferential data analysis were undertaken. For both the 
original and revised questionnaires 5 pre- and post-test scores were to be 
compajred utilizing a correlated t test ^ with the minimum level of signifi- 
cance set at ,05* In the case of those revised questionnaires for which 
only post-test scores were available (due to the late introduction of the 
former) 5 the number of items answered correctly by each participant and 
the overall percentage of correct items %ms determined. The criterion 
for pro^ajn success was set at seventy-five per cent of the participants 
attaining a mastery of siKty-flve percent of the items. 

Ill, PROGRAM mprE^ffiNTATION 

The Program was housed in two adjoining rooms in Public School 1^9 
(Manhattan). The Project Coordinator^ the family workers g and a secre- 
tary made efficient use of the space provided, and it seemed adequate 
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for the functions that were perfomed there* The Program^ s activities 
in the field involved the use of school classrooms and auditoriums ^ and 
these facilities varied in quality depending on the school* However ^ 
based on observations, all were adeqmte. 

It ms ohvious that the Broject Coordinator and his teaching staff 
of three fajnily workers understood the objectives of the prograjn, were 
dedicated to what they were doings and worked well together. The Prograan 
team arranged a significant number of sessions throughout the year. Fur= 
thermore, there was a definite concern on the part of the staff regarding 
the effectiveness of the sessions* This tos seen in (1). the time and 
effort expended in obtaining and reviewing an impressive array of materia 
als; (a) the creation of a list of eommunity services and agencies that 
supplied materials and guest speaiGrs; (3) the development of prototypic 
lesson plans for three of the content areas - these lesson plans provided 
a certain degree of consistency from one session to another ^ without un-^ 
duly structuring each one; and (k) the willingness with which the Program 
Coordinator adopted new session topics to meet the needs and desires of 
the community. 

The Prograjn established effective and cordial contacts with selected 
schools within the districts covered. School administrators and drug 
coordinators were pleased that the Program was in their schools ^ and 
teacher requests that the cycle be rep'eated with other classes were not 
uncommon, toe measure of the effectiveness of Education in Action was 
that it served as a type of resource center ^ loaning materials and sug- 
gesting speakers to those schools not participating directly in the ^ograr 

Besides the e^^ertise of the family workers who conducted most of 
the sessions, the ^ograjn relied heavily on films and printed materials 
provided by public and private coiranunity organimtions . These materials 
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were generally supplied -without cost, although occasionaHy filjns were rented 
or purchased outright. The literature and filme varied in quality ^ but were 
probably the best that could have been obtained ^ given the fact that only a 
^ small percentage "of the budget' TObS allbcated" f or the 
of such materials* 

GDhere was one mjor deviation from the original Program proposal. 
While the Program was always concerned with such health questions as venereal 
disease^ alcoholism, and drug abuse, the initial thrust was aimed at the last 
one. In fact, one aspect of the program proposal asked that the evaluation 
design incorporate a comparison of drug arrests between those exposed to the 
Prograjn and a control, group. However, the focus of Education in Action changed 
during the sioimner of 197^* Community and school feedback indicated a 
dramatic rise in venereal disease and alcoholism among teenagers. In addition, 
it proved impossible or impractical to obtain police records of individual 
drug arrests. Therefore, ^ the emphasis of the Prograjn was widened to give 
equal attention to all content areas. 

Several minor changes were also made. The Prograjn office was relocated 
in November of 197^ from 501 West 125th Street,, Manhattan, to Public School 
IU9 (Manhattan), This move was made possible by the good relabions that had 
been established between the Project Coordinator and the P,S* IU9 administra- 
tion. This change tos a wise one for several reasons. First, it gave the 
Program a location more central relative to the schools being served. Second, 
P.S. 1^9 was physically linked with another elementary school, P.S, 207, thus 
rainimlzlng the time and effort necessary to service the latter * Third, the 
relocation made more visible the Program- s relationship to the school system, 
distinguishing it from other civic agencies. 

Another modification was in the designation of this component. Tlie 
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original name^ which failed to really differentiate the oOTiponant flrom 
others in the City-wide Umhrella Program^ was changed to the more unique 
and dyiiMiic-Boundlng Education in Action* 

?5i.e„ri^ge ,md _focui^ of operation for the Program was also altered 

scmewhat. It was felt that the SPMK Drug ^ogram at George Washington 
High School (Majihattan) ms successful^ and that EduQation in Aat ion's 
presence there would be imneceisarlly duplicati-ve. Therefore ^ that school 
was dropped f^om the ^ogram^ and Puhlic School I56 (Manhattan) ms sub- 
stituted. (The parents of chiiaren in the latter institution had reques- 
ted affiliation with the iftrogram, ) ThiB change allowed Education in ' 
Action to concentrate and refine their activities on the elementary- and 
Junior high school levels since George Washington had been the only high - 
school serviced. As a result of this change ^ however ^ the Prograjii no 
longer had any participating schools in District 6, One other modifi- 
cation was the substitution of Junior High School U3M for I3M. The latter 
left because of orgralEational prohleins. 

Finally^ the Program staff Is to be commended for the introduction " 
of workshops in the areas of breast cancer ^ hypertension^ and sickle cell 
anemia; as well as the sponsoring of a two-day blood^oHle program* All 
TOre initiated in response to an analysis of community needs* 

The Education in Action PrograjTis then 5 was an active and seemingly 
effective one* The sessions that were held directly pertained to the 
program objectives* The Project Coordinator and his teaching staff un- 
derstood their community j related well to administrators ^ teachers ^ stu- 
dents, ^and themselves; and were able to locate and tap civic agencies 
for 'supporting materials and speakers, 

IV* raOGRAM EPPECTIVEOTISS 
The grant proposal submitted by Education in Action specified that : 
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the primary evaluation criterion would be pre- and post-test scores on 



content queationnaires , Data 


relative 


to this 


criterion are aBsembled 


In Tables 1 and 


2. 


Table 


1. 






Compajrlion of Scores on Content ftuesti 


onnairai 


Administered 


to Adults 




Number 


N 


nnrTfict 


S.D. 


t 


Alcoholism 

pre-test 
Post-test 


10 

10 


h3 
h3 


9.16 
10.29 


2.37 
1.67 


2.60* 


Cancer 

Pre-test 
Post-test 


17 

17 


h3 
h7 


13.91 
15.36 


Z.kk 
1.00 


3.66* 


Drug Abuse 

Pre-test 
Post -test ' 


10 
10 


35 
35 


. 8.66 
9.kO 


1.6U 

.93 


2,30* 


Hygiene 

Pre-test 
Post-test 


10 

10 


35 
35 


9.66 
9.57 


.53 
.80 


0.52 


Venereal Disease 
Pre-test 
Poet-test 


13 
13 


i+2 
ho 


11. U8 

12.28 


1.38 
1.00 


2.97* 



NO^i The negative t^ value Indicated that the posttest mean was less than 
the -/Pretest mean* 

An analysis of Table 1 reveals that the adult TOrkshops recorded 



statistically slgnlflcajit positive results in all but one of the content 
a^aas In which questionnaires were administered, (it should be noted 
that the revised Instruments were introduced too late In the year to be 
employed with the adult workshops , This situation was cornpounded by the 
fact that the late spring sessions tended to be in the content areas re- 
cently added to the program, for which no evaluative instruments existed,) 
Since the method of presentation was similar in all cases, possible ex- 
planations for the variable sucGesa might bet (1) differences in the 
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quality of the presentationi| (2) the level of prior knowledge that par- 
ticipants broTjight to each content area* (3) questionnairea that were not 
valid and/or reliable; and (k) fluctuationa in the Interest level of each 
content area to the participants, me data doei nr t allow for concluiive 
statements In thii regard. However ^ the ahove dis cues ion should not die- 
tract from the overwheljaing success of the Program in working with adults 
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10.97 


2.02 




Poit-test 


18 


Us 


13. 83 


1.93 


, 6.31+X 


WSfll w ^ J. 














10 


61 


9.10 


1.00 






10 


40 


9M 


0.80 


1.93 












Pre=teit 


18 


67 


15.07 


1.08 




Post-test 


18 


65 


15. 35' 


1.39 


' 1.28 


Drug Abuse 












Pre-test 


10 


218 


8.1+1+ 


1.36 




Poat-test 


10 


100 


8.1+0 


1.13 


0.2o 


Drug Abuae 












Pre-test 


18 


29 


12.90 


3.1+0 




Post-test 


18 


28 


16.1+6 


1.32 


5.17* 


Hygiene 












Pre-test 


10 


98 


9.07 


1.26 




Poat-tast 


10 


78 


9.28 


1.00 


1.23 


Venereal Disease 












Pre-teat 


10 


7k 


7.35 


1.37 




Post-test 


10 


82 


7.59 


I.3I+ 


1.07 


Venereal Disease 












Pre-test 


18 


U9 


16.82 


0.1+8 




Post-test 


18 


35 




1.1+8 


1+.81+* 


mTEt The negative t 


value s 


Indicated 


that the posttest means 


were leas 


than the pretest meani 


s. 
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*p<.Ol . 













Table 2 presents similar data for student participants in the Edu- 
cation in Action prograais. In few of the five content areas ^ a compari- 
son was possible uet-ween scores on the original and revised questionnaires. 
..toly in the area. of hygiene Is this not possible. While the student re- 
sults are not as impressive as those involving adults ^ the ftogram must 
still be Judged moderately successful in two of the content areas ^ alco- 
holism and drugs. Statistically significant positive results ware ob- 
tained on one questionnaire in each of these two content areas. The 
least successful aspect of the Pi'Ogram was clearly that ^concerned with 
venereal disease ^ where the revised questionnaire revealed a significant 
loss from pre-test to post-test- ' ' 

The e^lajiatlons offered above to e^^laln the variations, in the 
Progr^ effectiveness for adults also apply in the case of the students* 
In addition 5 it should be noted that in ttie case of the alcoholism^ drug 
and venereal questionnaires ^ large. variations exist in the results ob- 
tained when using "the revised instruments as opposed to the original 
ones. In view of the greater number of .items 5 the revised questionnaires 
are the more reliable of the two. Thus 5 the fact that statistically sig- 
nificant gains were evidenced in the revised alcohol and drug question- 
naires is encouraging. However ^ the negative finding on the revised 
venereal disease questionnaire cannot be Ignored, It is difficult to 
understand how Education in Action could be so successful in other areas 
and yet havje^ such negative results here. Possibly, this particular ques- 
tionnaire is unreliable in some respect. It should be subjected to ' -r--^'--- 
thorough analysis and evaluation before being used again. However 3 these 
aberrant results should not obscure the generally positive nature of the 
findings. 

In one casei data was available only for the post«test adminlstra» 



tion of a questionnaire* Theae itatistias are also imlque In another 
aspect, in that they involve junior high achool studentii whereas the - 
data contained in Ta^le 2 was for elementary school etudente. An eMa- 
ination of Table^ 3 ^eveali that for this particular group the level of 
maitery specified in the evaluation design - ieventy-flve per cent of 
the pa^ticlpBiitB attaining iixty-five per cent of the items - wai not 
achieved. Only thirty-two per cent of the pM*ticlpMts scored at the 
mastery level. Without additional statistlci f^om the Jimlor high school 
population^ it is difficult to conclude whether the Prograjn ia really 
less eucceasful with this age group than with younger children; Further 
testing in this area is advised In the future* 

Tahle 3 

Distribution of Post-Test Scores on the Revised Driig Questionnaire 
Administered to Eighth Grade Students 



No. Correct 


f 


Cunimulatlve f %f 


Curranulative . %f 


16 


3 


3 


.06 


6 


15 


3 


6 


.06 


12 


Ik 


5 


11 


„ .10 


22 


13 


5 


16 . 


.10 


32 


IS 


5 


21 


.10 


k2 


11 


5 


26 


.10 


5S 


10 


3 


29 


.06 


58 


9 


k 


33 


.08 


66 


8 


8 


^1 


.16 


82 


7 


7 


k6 


.Ik 


96 


5 


1 


k9 


-.02 


98 


3 


1 


50 


.02 


100 


Education in Action 


also indicated 


in their grant proposals that 


they would evaluate 


the 


response of the 


participants . 


However, no sys- 


tematlc attempt was 


made 


to oollect the 


reaotlons of 


either the adult 



or student populations* Based on the evaluator^s observations, the mo- 
tivation and interest level of the adults was hi^. Attendance was good 



to excellent 5 and often Included mmy school faculty members who elected 



to spend a eonference or limch period in the workehop. (In the latter 
respactj It could be argued that Education in Action provided in-iervice 
education to these teachers*) 

-Observationi .of the ^itudent population preiented^m - 
When the cooperating teacher actively assisted the family workers, the 
students were quiet and appeared to. he interested in, md affected hy^ 
the preaentation. However, when the faaily workers were left on their 
own^ they frequent^ had difficulty controlling the students iJid/or 
keeping them interested In the session activities. ^ 

V, PROGMM sroENGTHS Am mAiorassES - . ^ 

In conclusion, several qualitative strengths of the Program deserve 
mention. First, the Project Coordinator was well-qualified for his posi- 
tion, and offered the Program an apparent expertise in management skills* 
In addition, he constantly sought ways to improve the program, especially 
through the addition of new subject workshops and materials* Finally, 
due to his relatively long tenure with the Program, the Project Coordi- 
nator brought a significajit amount of e^erience to the Job^ which im- 
doubtedly prevented mlieh waste in the expenditure of time and effort* 

Second, the Project Coordinator and his teaching staff established 
excellent rapport with the school administrators, drug coordinators, and 
teachers with. whom they cooperated. This was evidenced by both the let- 
ters of thanks and those requesting services that they received* Third, 
the H^ogrMi^s success -gave it a certain amount of visibility. Thus, 
Eflucatlon in Action frequently received requests from people within and 
without the community for information regarding the availability of cer- 
tain presentations 5 printed materials, and films. 

The only apparent weakness in the Program, seems to be in the method- 
ology of student instruction. Based on observations, it would appear 
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that the pedagogical strategiei and techniques being employed could be 
improved. (See Reconmendatlon No, 3 below for a further elaboration on 
this point, ) 

The following suggestions should be Interpreted as mys that Edu- 
cation in Action might strengthen an already relatively successful pro= 
gram I 

1. In addition to the questionnaires that test knowledge acquisi- 
tion^ some attempt shoiild be rmde to systematically sfanple the adults , 
students and cooperating teachers for their opinions of each presentation^ 
or at least the cycle as a whole* This would provide a second measure of 
effectiveness for the program. 

2. A mora structured "follow-up" system ought to be instituted for 
the student workshops, whereby Education in Action personnel and partici^ 
pating teachers would cooperate to reinforce Program learnings after the 
formal presentations have ended , 

3. While some attempt has been made to train the family workers 
for their instructional tasks ^ further li^rovement seems necessary regar= 
ding methodology. Since the teaching staff are conmitted to the TrogTmm 
and desirous of succeeding^ these attitudes should be capitalized on by 
further training in questlonnlng techniques ^ motivation, concept develop- 
ment^ ajid inquiry procedures* 

k. Since this component perfoMis a similar function to others in 
the City-wide Umbrella ProgrM^ attempts should be made to visit and ob^ 
serve the operation of these \mits. This would allow for a greater shar- 
ing of infoiTnatlon and resources ^ and prevention of unnecessary duplica- 
tion of effort. 

5, The Program staff shoiild continue its efforts to devel^ materi- 
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ale on a reading level Gommeneiirate 'vrith itudent abilities* Since the 
interim report i some progress in this area has been noted, 

6, Some attempt should be made to determine whether the small groiflp 
workshop is the most effective method of instruction in each of the con- 
tent areas J and equally valid for adiolts and students. If possible ^ the 
importance of audio-visual presentations and/or distribution of printed 
literature should also "be determined. 
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F^epared byi Rich^d E, Baecher - 

I. nrmoDUCTioN 

The Bilingual-Bieulttiral Progr^j in its first year of implementa- 
tion in CoOTnunity School District 12 5 sou^t to instruct Spanish-speaking 
pupils in a second language (inglish)^ and to reduce sdiolastic retarda- 
tion in the participating students by providing instruction in Spanish 
as they were acquiring basic English language skills, Additional3^, the 
Program aimed to aupaent their reading levels in English, 

The Bilingual-Bicultural ^ogram was organized in grades one through 
six. One hundred and sixty- two (162) students who received a rating of 
CDEF on the Scale for Hating Pupil \s Ability to Speak English participa- 
ted in the ^ogram. An experienced ^ bilingual TEBL teacher coordinated 
the specialized activities of ten bilingual paraprof essionals , The TESL 
coordinator met with each paraprofessional bi-weekly frOT 2:00 to 3iOO 
P.M. for problem- solving workshops 3 demonstration lessons^ and mterials 
development activities. 

The bilingual paraprofessionals, the majority of Puerto Eicm back- 
groundj served as an articulation link between the individual teachers ^ 
the eoordlnatorj and the parents. Eight of these paraprofessionals worked 



in the clasiroom and directly reinforced the lesions being taught in 
•English and Spanish- The remining two paraprof essionalej particularly 
skilled in TESL activities ^ worked directly with the TESL coordinator. 

The TESL teacher^ shading a roCTi wherein another prograsi was func- 
tioning^ enthusiastically ^carried out the following responsibilities i 
(1) coordination and realization of Program obJectives| (2) in-service 
training of bilingual paraprofessionals; (3) planning of enrichment 
activities for children j and {k) orientation sessions with parents. 
The bilingual paraprofessionals ^ in addition to giving smaH group in- 
struction 5 provided the target students with a glimpse of Hispanic cul- 
ture and escpanded the children's oral ^d TOitten ejqjresaion through 
language development exercises and related activities* They worked 
closely with their assigned regular teachers and planned cooperatively 
with them in all content and academic skills areas • 

II, EVALUATIOT DESIGN 
In order to detemine the degree to which the Bilingual-Bi'cultural 
Prograjn met its objectives ofi (l) providing instruction in English to 
Spajiish dominant pupils | (g) reinforcing concepts in Spanishi (3) in- 
creasing their reading skills in English j and (U) ascertaining the ef- 
fectiveness of selected aspects of the Program^ e.g. bilingual personnel 
involvement 3 the following evaluation procedures were ewrployed* 
1, Observation of the to-Going Prograjn. 

Formal mid informal classroom observations were conducted for six 
days throughout the school year. Each bilingual paraprofessional was 
observed and interviewed along with the TEBL coordinator and a sampling 
of regular teachers* 

2* Analysis of Official Records and Materials 



Various conmierclal and staff produced materials m& equipment employed 
in the Program^ letters and bulletini distributed to parents regarding 79 



the Program^ offiGial records of pupils^ currentl^r used diagnoitic in- 
struments /attendance foils ^ etc, were inspected, 
3« Ana^sis of Test Results i' 

J ?^Pll.PH^H™§B selected subtests of the Inter -American 

Series Tests of Reading in Engli&h, and data derived from the English 
verBion of the Boehm Test of Basic Concepts ^ were analysed to evaluate 
any increase in hasic reading skills concept attainment of the par- 
ticipating youngsters* 

Analysis of Data Yielded From ; 

M Questionnaire - Pgraprofessional Involvement and Training 
^ogram - designed to yield information concerning the 
perceptions of the bilingual personnel and their roles, 
("b) Scale for Hating Pupil Attitudes to Self and School - 

designed to collect information from the regular teachers 
concerning their percepticns of chajige in attitude on the 
part of the target population. 
The data from these instruments were analyzed to supplement ~tEe"' 
test results yielded from the Inter -American Series and the Boehm Test* 
Information in the form of qualitative data on the perceptions of the 
hillngual paraprofesslonals and teachers was gathered by mea-ns of these 
rating scales and questionnaire. 

Ill, PROGRM IKPLEMMmTION 

Staffing/Activities 

The TEBL teacher worked out of a room that served as the focus of 
the Program, In addition to instructing small groups averaging five 
pupils on a daily basis in English as a second iMguage, the lESL coor- 
dinator conducted workshops and training sessions for the bilingual 
paraprofessionals* The latter activities occurred between Si 00 and 3! 00 
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P*M, imd were attended by three pa^aprofessionals for each hour to allow 
.for close contact and guitonce. 

Eight bilin^al jaraprof essionals instructed small groups of desig- 
nated target pupils in regular classrooms . Among the varied and -nujner- - = 
ous activities oh served directly and described in their '■paraprof essional 
week]4^ logs 5" these were notedi (1) assisting students in the spelling 
of English words; (2) reinforcing their efforts in cursive "writlngj (3) 
teaching reading skills by means of the language es^erience approach and 
phonics method; (h) developing oral/aural language skills | (5) providing 
tutorial help in mathematics; (6) en^)haslzing mportant cultural aspects 
ih social studies I (7) enhancing the self concept of the pupils through 
special assistance; and (8) planning and encouraging copiitlve and lan- 
guage development through varied activities and enriching field trips. 
These were only a few of the varied educational activities engaged in 
by the p^aprofessionals in collaboration with their regular teachers* 

The two other paraprofessionals worked directly with the coordinator 
and serviced children bl-^^reekly in groups of four^ for periods of fifty 
minutes. A multi-dimensldnal approach was employed in the room^ including 
use of audio-visual aids 5 mterials stressing oral language development 
skills 5 as well as teacher and paraprofessional made materials aimed at 
fostering each child's needs and abilities. 

In sum^ the specific pattern whereby bilingual personnel served as 
all importajit link between the target children^ the regular teachers and 
the IESL*^coordinator was operationally sound 5 representing a necessary 
adaptation of the traditional "pull-oub" English as a Second Language 
ProgrMi, Through the dedication and cooperativeness of the ten bilingual 
paraprofessionals 3 as manifested in their conversations ^ instructional 
activities and the individual diagnostic packets for each target pupilj 
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the Prop*am proved to be an maginatlve response. to a lerioui edueational 

challenge , ' 

Materlali /Equipment 

In that pai't of the room deilgnated for the Bilingml-BiGult^^ 

Programj these sets of materlali were utilised: (1) SRA Tanguage Devel- 

opnient Prograjti i (g) Qrm l English ; Language Skills Text (available on 

tape cassettes also); (3) Merrill LlngulstlQ Readers | (U) Puerto Rico 

en Mi Corazon ; (g) English in Action | (6) Teaching English as a Second 

Language ; (?) Learning English as a Second language , 

Theme materials were supplemented by ti?acher and paraprofesaional 

made jmterlals that dealt with specific lang^aage skills* The latter 
were Inspected and were of superior quality. Sets of lajiguage raaeters 

aiid other educational hardware were utilised adequatel^r In the Program. 
' nother indicator of the Prograjii*s mjor strengths was the presence 

in the room of a "nulture corner 5" a tahle pleasantly decorated with 
various books on the cultural heritage of the target population. These 
books were made available to the pupils and were used by the bilingual 
paraprofessionals for lesson plans. Finally ^ large sized photographs 
showing the staff working with the children were displayed on the closet 
door, 

TV, mOGRm EFFECTIVEmSS 
Data pertaining to the effectiveness of selected aspects of the 
Program were gathered from regular teachers and bilingual paraprofessionals* 
Specially prepared rating scales and questionnaires were administered to 
all the participating staff. 
1- Analysis of Rating Scale Results 

Teachers* perceptions of change In pupil attitudes tOTard self and 
school were collected from an informal instrument entitled "Scale for 
Rating Pupil Attitudes to Self and School." (See Appendix A for copy of 
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rating scale). The purpose of the instrument was to ascertain any change 
=ln target student attitude from the viewpoint of the regular teachers 
directly involved in the program. It was reasoned that the perceptions 
of the regular teachers would form an appropriate hasis to identify any 
significant changes in pupils' attitudes toward self ajid school as a 
result of the Prograjn, 

Table 1 presents the cumiilative frecLuencies and means of the target 
groups in grades 1=6. 

Table 1 

Proportions and Means of Target Population in Grades 1=6 
Within Categories of "Pupil Attitudes to Self and School" 



.Grade 


Unit of Time 


0-1 


2 


3 


k 


5 


N 


Max, 
Dif . 
Obs. 


VL\x., 
Dif. 
Exp. 


MeajiB 


First 


Prior* 


5 


3 


8 


5 


S 


23 




9 


2.8 


No^* 


k 




5 


11 


3 


23 


6 


3.i+ 


Second 


Prior 


1 


3 


5 


5 


k 


18 


1 


8 " 


3.U 


Wow 




3 


5 


6 


k 


18 


3.6 


Third 


Prior 


k 


13 


1 


1 


1 


20 


9 




2.2 * 


Now 


1 


h 


9 


6 




so 


3.1 


Fourth 


Prior 


1 


7 


10 


6 


■ k 






10 


3.2 


Now 


1 


3 


5 


13 


7 


28 


7 


3.9 


Fifth 


Prior 


S 


5 


6 


9 


3 


25 


1 ' 


' 9 


2.2 


Now 


1 


U 


8 


8 


U 


25 


2.3 


Sixth 


Prior 


3 


. 5 


6 


a 


1 


23 


3 


7 


2.9 


Now 


2 


k 


6 


7 


k 


23 ■ 


3.^^ 



*Prior to programj **Present ; '>H^=^Signif leant at the *03 level 
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Based upon the application of the KoMogorov-Smirnov Two-Saaple 
.Test statistic^ a significmt difference was noted among third grade 
teaGhers. They per'seived significant changes In pupil attitudes toTOrd 
self ^d school* It can be reasonab]^ asserted that this difference was 
due to the ^©gram design. Although significant differences were not 
found among the other grades ^ an inspection of the means (Prior-Now) of 
Table 1 indicates a positive direction in all instances. It should be 
noted that all the scores in the "now" classification fall in the "av- 
erage change" category* 
2. Analysis of Questionnaire Results 

^e involvement of the bilingual paraprofesslonals was an Important 
ingredient in the entire Program. Data concerning the degree of their 
Involvement were derived from an informal questionnaire designed to tap 
their education and e^^erlence^ and their perceptions of the ^ogram* 
Table 2 presents the responses to some of the items on the questionnaire. 

Table 2 

Responses of Billngiial Paraprofesslonals to .Questionnaire 

1, How many years of school have you completed? 

1 - completed some high school 

2 - had a high school diplcnna 

k - had completed some college work 

1 - had a degree from a two-year college 



2. 


Are you currently 


attending school? 




5 - yes| ^ - no 




3. 


How many years of 


experience have you had as an educational assls- 




tant or a teacher 


aldej not counting this year? 




Median years i 3 
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Tatle 2 (cont* ) 



k. What do you think might be the most important rays in which you 
will help the teacher in the class? A sampling of responses 
included: 

a* reinforcing content area matter and skills given by the teacher | 

b, assisting the teacher communicate with billngml pupils| 

c, giving and correcting homework; 

d* help slower groups and learners in small groups; 
e* help teacher control. 



5* What do you think will be the best things to happen in the class- 
room in which you spend the most tme ttis year? Among the responses 
were: 

a* students improye scholastlcallyj 

b . students achieve high level in all areas j 

c, students learn to read and behave;' 

dp produce more material and realize own ideas | 
e, more time with target children. 
— *^ . . . ■ 

6, What do you thiiA will be the most Important problems in the class- 
room in which you spend the most time? Some of the answers weret 

a* discipline and reading; 

b. limited space to move; 

c. interesting lessons; 

d. keeping the groups smll; 
e * language probleins . 



7* What suggestions do you have for: improving the program in this 
school this year? Some responses to this question were: 

a* time to prepare materials and lessons | 
b* more time to work with pupils |^ 
c, preparation periods with teachers | 
dg better screening. 



Based upon the responses to this questionnaire ^ it can be concluded 
that the ten bilingual paraprofesslonals represented an e^erlenced and 
dedicated team= of sensitive individimls who were receptive to continuous 
improvementV 

3* Analysis of Test Results 

Pupil performance data derived fr^ the Boehm Test of Basic Concepts^ 
English version^ and from selected subtests of the Inter -American Series 



of Raading in English ^ were submitted to a pre-test and post-test anal- 
ysis. A t test for correlated SMiples was applied to the correlated 
raw scores. 

Table 3 presents the findings for the first grade on the Boelun Test, 

Table 3 

Pre=Test and Post-Test Performance 
; ' on Boehm Test 'of Basic Concepts - First Grade 



Grade 


N 


Pre^ 


=Test 


Post-Test 


t 






Mean 


SD 


Mean SD 




1st 


27 


UO.71 


3M 


^3.9^ 2.U3 


2.78^ 



*Signif leant at the *01 level 

Table h simniarizes the results of the Inter-American Test of Reading 
for grades 2-6* 

Table h 

Pre-Tent and Post-Test Performance 
on Inter -American Test of Reading: Second to Sixth Grades 



Grade 


Test 


Subtest 


N 


Pre-Test 
Mean SD 


Post-Test 
Mean SD 


t 


2=3 


R-l-DE 


Vocabulary 
ComprehenBlon 


33 
32 


2k. 4 
20,i+0 


7. '60 
8.22 


31.36 
26.66 


6.08 
6.73 


7.63* 
5.51^ 


k 


R-l-DE 


Vocabulary 
Comprehension 


11 
Id 


29.27 

33.10 


5.85 
6.92 


35.1+5 
33.80 


2.02 

h.m 


h . 3h* 
5.88* 




R-2-DE 


Reading Level, 
Vocabulary . 


55 
55 


23.36 
25.75 


5. 65 
6.30 


27.05 
28,01 


6.21+ 
6.32 


5.99* 
I+.0I+* 



*Signif leant at the ,01 level 
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It should "be noted that Grades 2, 3 Md some pupils in Grade k 
.took Level 1 of the Inter -Americaji Testj Level 2 was administered in 
Grades 5^ and 6, These levels were the most appropriate for these 
students * 

Sumpa^y of Educational Test Data 

Significant differences trcm pre-test to post-test were noted in 
all classes. The obtained differences were significant at the ,01 level. 

Based upon these findings ^ it is cleanly evident that the Bilingual- 
Bicultural Program accomplished its ohjectives of providtng instruction 
in English and increasing the students' reading skills in English* 
V, PROGRAM SIRMGTIK MD WMKUESSBS 

Among the many strengths that stand out as characteristic of the 
Billngual-Bicultural Program in District 12 ^ these were the most impor- 
tant : 

1. Experienced and dedicated bilingual personnel worked intensively 
with the target pupils in the Program, The utilization of these indivi- 
duals as a link "between the regular teacher Sj students and other staff 
merahers represented a significant and innovative program design* 

2* Ihe instructional use of the student ^s dominant language (Spanish) 
for purposes of concept reinforcement and greater comprehension reduced 
the language barrier of many pupils and fostered their conceptual devel- 
opment, 

3, A wide variety of printed and audio materials and equipment 
for teaching English as a second language were available in the TESL 
component of the program. Intensive language development ajid enrichment 
activities 5 under the supervision of qualified bilingtml personnel^ were 
successfully implemented* 

The willingness to Gooperate with the bilingual paraprofesslonals 
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ajid to Increase the FrogTom' b impact manifested by the regular teaGhers 
was a highly positive featiore. 

5* The majority of the participating yomigsters responded enthusi- 
astically to the Program. It was evident that many pupils felt success-. 
ful in their comprehension of content areas and reading skills. ^^^Mdi- 
tionally, their attitudes toward school ^d self increased positively as 
a result of the Program. 

The Bilingual^Bicultural Program appeared to have certain weaknesses. 
These Included: 

1, Lack of adeq^uate supply of materials that could be used for 
various content areas, especially for this group of students. 

9. Insufficient commimication among all the staff involved in the 
i^ogram^ especially the regular teachers. The latter represent an im- 
portant source for suggestions to increase the effectiveness of the 
Progr^ in the future, 

3. Need for a more sensitive selection procedure and for an adjus- 
tlve plaaement system, whereby ctudents in need of this, specialized ser=« 
vice receive it throughout the duration of the Prograjn. ' 

VI. RECOMOTDATIONS 
The Bilingual-Bicultural Program in District 12 was highly success- 
ful in Increasing, to a significant degree, the bilingual aMUties of 
the students participating in the Program. This Program, then, has given 
every indication of achieving its stated objectives. It 'well m.erits 
continued support in the future. 

The following recomm_endations are submitted to the District for 
their considerations 

1, The involvement between ^ogram staff and regular teachers of 
the target pupils should be fostered. An effort should be made to In- 
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crease communication ajnong ^ograra staff members and regular teaehere. 
While it was evident that regular teachers a^e willing to cooperate more 
fully ^ a definite schedule of planned meetings would he helpful, 

2* A system for more effeGtiye and sensitive selection of parti« 
cipating pupils 5 and for\more flexible placement would do a good deal 
to enhance the Program, A possible direction might be greater emphasis 
upon a diagnostiC'-prescriptive approach. 
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SCALE FOR RATING papIL ATTITUDES TO 
SEIJ' Am SCHOOL 



Pupil's Naaie , Claae_ School 



Diractions, Plaass rate the pupil whose name appears above on each 
item, flrat in tp.rffls of his attitadci prior to partici^ 
pation in the spaoial program fror ESL students ^ and dieii 
in terms of present attitudas* Each item has t^^o parts* 
Prior, Now, Circle the number 1 ("low rating--) to 5_ 
C'higheit rating") to indicate your rating, 0 refers 
to "can-t rate" and ^ atanda for "average rating", 

1« Seems happy and rslaKed, 

Prior 0 1 2 3 4 5 

Now 0 1 2 3 4 5 

2, Gets along well with claaamates* 

Prior D 1 2 3 4 5 

Now 0 1 2 3 4 5 

3« Seems to feel confidant in his fibilities 

Prior 0 .1 2 3 4 5 

Now 0 1 2 . 3 4 5 

4* Appears to take pride in his/her work. 

Prior 0 1 2 3 4 5 

Now 0 1 2 3 4 5 

5. Cooperates with teachers, teacher assistanta and pupils in workin 
on class problems or projects 

PrioL^ 0 1 2.3 4 5 

Now 0 1 2 3 4 5 

6* Corapletes classwork and homework assignraencs s 

Prior 0 1 2 3 4 5 

Now 0 1 2 3 4 5 

7. Controls inappropriate behavior ^ 

Prior 0 1 2 3 4 5 

Now 0 1 2 3 4 5 

8e Pays attention to class coom acttvitias^ 

Prior 01 2 3 4 5 

Now 0 1 2 3 4 5 

9« Appears to gain satisfaction from his work 

Prior 0 1 2 3 4 ; 5 

Now^. 0 1 2 3 4 5 

10, Participates enthusiastically in class activities. 

Prior 0 1*2 3 4 5 
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"mLP-NEIGHBORHOOD CENTER PROGRAM" 

Prepared by* Michael L, Berger 

I , INraODUCTION 

The Help=Nelghborhood Center Program 5 former lly knowi as the School" 
Commimity Interaction Prograjn-Corranimications No, 7^ tos designed primarir 
to provide educational services to the adult and student populationi of 
Community School Districts 13 and I6. The Pr^ogrMi consisted of a series 
of assemblies and discussion workshops held at cooperating elementary and 
Junior high schools within the' districts . The main objeGtlve of these 
assemblies and workshops was to Increase knowledge and tinder standing in 
such content areas as: venereal disease; drug abuse; welfare rights; 
mental health; feminine hygiene; consumer affairs; alcoholism; child de- 
velopment; parent-child and peer group relationships; pupil records; and 
to Increase parent communication withj and influence upon^ the schools. 

The Center basically served In a liaison capacity^ linking corrmunlty 
and school requests ^or Information with local resource people and or- 
ganizations able .to provide it. Besides orrnnizing the workshops and 
assemblies 5 the Center staff also generated Interest in them -by person- 
ally Informing parents In their homes ^ when they brought their children to 
school 3 and by "flyers" sent out through the schools or parent organlza- 



tioni. The iessions were uiimlly conducted bjr representatives from 
varioui private and public organisations, such as the United Parents 
Aisoalatlon and New York ty Health Drpartment, Members of the Center 
staff occasionally conducted workshops with students; thoughj here too 3 
guest speakers were used. 

II, EVALUATION DESIGN 
The evaluation design for the Help Neighborhood Center Rrogram ini- 
tially involved three aspects. Firstj a written questionnaire was to be 
developed by the evaluator and the Center staff for each of the content 
areas listed above* This was to be administered to participants in each 
discussion workshop and assembly immediately preceding the activities 
for that session. The same instrianent tos then to be readministered Im- 
mediately following the workshop, Seeondj a record was to be kept of 
the number of persons seeking the services of the Center and the number 
attending the Individual workshop. Thirds an infornml attempt was to be 
made to elicit feedback from participants regarding their opinion of the 
relative worth of each session. 

While the basic evaluation design remained unchanged throughout the 
year, the questionnaires were substantially modified in the spring,"^- The 
original Instruments had been wltten by the Center staff or by some of 
the private organizations that provided the guest presentations, Since 
the evaluator was not appointed until mid-winter ^ it was decided to ac- 
cept the results of these questionnaires for the first half of the year 5 
while at the same time studying the instruments for possible revision. 

Unfortunately 5 the original questionnaires were deemed inadequate j 
neceseitating the creation of new ones in the spring. Improvements in- 
corporated In the new instruments included: (l) an Increase in the num- 
ber of questions to a uniform eighteen, (There had been from five to 



The chances of obtaining statistically reliable results was therebsr an- 
hancedj (2) the reading level and phraseology of the questiong wai modi- 
fied to minimize language Gomprehension difficulties and provide parallel 
syntax; (3) the disproportionate number of times that "true" tos the cor- 
rect response was rectified by creating a more even "true/false" distri-^ 
bution of correct answers; and (h) provision was made to add the classi- 
fication "Do Kot Know'' as a possible response to all questions. This 
effectively eliminated the earlier "forced-choice" situation, which prob- 
ably inaccurately measured the true content knowledge of the participants. 

As a result of these changes in the written instruments ^ two differ- 
ent types of inferential data analysis were employed. For the original 
questionnaires 5 pre and post rscores of parents and students were compared ^ 
utilizing a correlated t test^ with the minimiHn level of significance set 
at ,05. In the case of the revised questionnaires ^ the number of items 
answered, correctly by each participant^ and the overall percentage of 
correct items was determined. The^ criterion for program success im,B set 
at seventy-five percent of the participants attaining mastery of sixty- 
five percent of the items . ^ 

III, PROGRAM II^mMNTATION 
There were no major deviations from the program proposal ^ although 
several :Tr\nor changes were implemented. The Center relocated in the fall 
of 197^ from kkk Sumner Avenue, Brooklyn , to its present location in Junior 
High School 258* This was a wise move since the Center retained its central 
location within the commiLiityg while at the same time enhancing its re- 
,lationship to the school system* As mentioned earlier, another modlfi«_^ 
cation was the designation of this component* ^e original unwieldly 
title was changed to Help Neighborhood Center, a naae more likely to be 
both remembered and accepted by the conmunity/ Finally, the range of 
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13 and 16, the adjoining District 32 was also serviced through contacts 
with one junior high and three elementary schools. 

The Center operated out of a single room office In Jimior High School 
258 (Brooklyn), While the Coorainator and staff made effective use of the 
space available to them, conditions at best remained crowded within the 
office. On the other hand, the facilities within the cooperating schools 
were generally adequate, and sometimes superior. The practice of serving 
refreshments at the morning workshops helped to improve the ambiance, and 
created a family-like atmosphere. 

The staff was badly hajupered for the first half of the year by the 
lack of a typewriter and ^ other supplies. Fortunately, this situation was 
rectified by mid-winter. However, the Center continued to lack duplicating 
equipment of its own because of the prohibitive cost of purchasing such 
equipment. The Center had to rely on the good will of the J.H.S, 258 ad- 
■ ministration for access to the latter 's equipment. Thus, a considerable 
amount of unnecessary time and effort ims expended on obtaining such 
services. It is a credit to the dedication of the Center staff that they 
were able to overcome these obstacles. 

Based on assembly and workshop observations and Interviews with the 
Center Coordinator and her staff of four, It woiild appear that the program 
ms effectively implemented. All five staff members were extremely compe- 
tent people who understood and applied the principles miderlying the program, 
were dedicated, tb what they were doing, and worked well together. During : 
the course of Its ten month operation, the Center arranged an imppressive 
number and variety of activities (see Table 1 below). FOTthermore,^- there 
was definite interest In the quality and effectiveness of the workshops.. 
This was seen in (l) the provisions/that were made for bllingiml presenta- 
tion (when necessary); and (2) the time and effort expended in previewing 
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The Center establiihed effective contacts with well-estatlished 
ccnttnunlty agencies and associations. Relationships between tham were 
cordial, and the cooperating services often took full responsibility 
for actually planning the workshops or assemblies. 

The Center progrun employed a considerable amount of printed mat- 
erials and films provided by public and private conununlty organizations. 
These materials were supplied, generally without cost, by the same agen- 
cies that provided the guest speakers for the sessions. The literature 
and films varied in quality, but were probably the best that could have 
been obtained given the fact that there was no provision in the budget 
for the purchase of such materials. The naterials were normally distri- 
buted as illustrative aids dia-lng the course of the assemblies and/or 
discussions, though on occasion they were used as the focus of the pre- 
sentation. 

Finally, the Center staff Is to be commended for following through 
on two of the recommendations made by the avalmtor in the interim report 
Greater cooperation with other, similar City-Wide Umbrella ftrogram com- 
ponents was evidenced, and was probably responsible for the Introduction 
of at least one new content area Into the Center's repertoire. Secondly, 
there was more efficient deployment of Center staff during the last half 
of the year, with the practice of all pers^nel attending each session 
eliminated . 

The Center Program, then, was an active and expanding one. The 
-sessions that were held related directly to the program objectives . The 
Coordinator and staff knew their community and becajne Increasingly aware 
of the public and private resourcea they could flraw upon, 

■ IV-, PROGRM EFFECTIVEHESS 
The grant proposal suhmlfcted by the Help Neighborhood Center epeci» 



-91- 

services and attenfiing workshops." Data relative to this criterion are 
assembled in Table 1. A total of sevanty-two (72) workshops or assem^ 
blies were held froin October tc mid^Jun^, with an attendance of 3|^^2 
persons; 2^928^ of whom were students. Several conclusions ieem warranted 
by these statistics* Firsts the Center was extremely active in attempting 

Table 1 

Participation in Workshops and/or Assemblies i October-June 



Topic N Total Attendance Students ^ Adults 



Drugs 


1? 


506 


5b6 


0 


Feminine Hygiene 


12 


550 


530 


20 


Welfare Rights 


7 


7k 


0 


7h 


Sex Education 


5 


140 


140 


0 


mio Is Responsible T 


p 




0 


12o 


Sickle Cell Anemia 


h 


U87 


U50 


37 


Consumer Affairs 


k 


95 


0 


95 


Physical Hygiene 


3 


3^5 


3h3 


0 


Pupil Records 


3 


71 


0 


71 


Commuji i c a t i on s 


3 


65 




so 


Venereal Disease 


2 


631 


631 


0 


Alcoholism 


2 


35 


0 


35 


Radiation 


1 


190 


190 


0 


Lead Poiioning 


1 


61 


61 


0 


Pollution 


1 


30 


30 


0 


Community School 
Board Elections 


1 


2k 


0 


2U 


Mental Health 


1 


10 


0 


10 


TOTALS 


72 


3,1+^2 




31h 
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to fulfill its mission. ApproxlmatHly nine workshops w©re held each 
month, for an average of more than two a week* Second ^ the addition of 
certain topics to their list of preGantations ^ specif icallj^ those of 
sickle cell anemia, radiation, lead poisoning, pollution ^ coinrminity school 
hoard elections and mental healthy indicates that the Center tos respon- 
sive to the needs of the adult community and the districts' school popu= 
lation. Third 5 the disproportionate niimber of workghops in each of the 
content areas also indicates that the Center served the needs of the 
commimity rather than its own predilections , if any. In this respect, 
it truly lived up to its designation as a ''help" center. .Fourth^ while 
the majority nf participants were overwhelmingly studants (Ssfp)^ the 
actual number of workshops/assemblies ^was more evenly divided between 
adults and pupils. In the foLirteen content areas devoted exclusively 
to one of these two populations, seven were designed for adiilta and 
seven for students. Of these, thirty sessions were devoted lo student 
interests and twenty^three to adult ones. The discrepancy in student/ 
adult attendance is, therefore ^ more a function of the type of program 
offered (assemblies) than any bias toward either of the two populations 
served. Finally , while the data clearly indicates that the Center fol- 
lowed the dictates of its constituency, this may have indirectly re- 
flected it away from one of its objectives. If the Center was designed 
to provide information in those areas of greatest social concern ^ then 
it is troubling to discover that only two workshops were offered on al- 
coholism, with a total attendance of 35 5 or one percent of the student 
population* The question may be raised as to whether the Center does 
not also have an obligation to lead^ as well as follow^ its constituency. 

The Center also Indicated in its proposal that they would evaluate 
the effectivaness of their program by the niunber of persons seeking ser- 
^ vices and the response of the participants. Judging from the letters 
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made available to the eii^aluator, and the introduction of new workshop/ 
assembly programs ^ it would appear that there ™s a signifiGant demand 
for the services of the Center and that this Increased as the year pro» 
gressed, ThuSj the Center was viewed ^5^" the community as a valuable re- 
source to be tapped whenever practical. 

Evaluating participant response is more difficult. No systematic 
atteii^t was made to collect the reactions of either the adult or stu- 
dent populations. Based on the evaluator's observations, the motivation 
and interest level of the adults was uniformly high. Given the time 
(early morning) and location (a public school) of the adult woT^kshops, 
the attendance was good to excellent. Just as significantly 5 those who 
were present generally stayed until the end of the presentation ^ or rmdm 
it clear that they had to leave due to other commitments* 

Observations of the student population produced mixed reactions . 
Those presentations offered in small group workshops evidenced %he sajiE 
characteristics as the adult ones^ with the obvious exception that the 
students were a "captive" audience # ^e assemblies^ however, seemed to 
be less effective. Significant numbers of students seemed restless and 
inattentive. This, of course, it not a phenomenon unique to Center pre- 
sentations, and may be due largely to the format employed. (in this re- 
gard j. see Recomniendation 30 

The final evaluation criterion for the Center program called for 
the participants to "be able to identify behavior patterns that will 
help \mderstand themselveS| others, and their children." To this end, 
the evaluation design stipulated the administration of a questionnaire' 
both before and after each presentation to determine whether increased 
knowledge had actually taken place, and If sOj to what degree* Unfor- 
tunately, the Center staff elected to follow through in this regard in 
only a limited number of cases. Reference to Tables 1, 2 ^d 3 reveals 
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that only 202 participants, out of a total popui,atlon of 3s^'+2 took any 
■pretest, iliis represents less than 6 percent. In addition^ testing was 
\mder taken in only five of the sf^venteen areas in which work ahops /assem- 
blies were held. Finally, beGause no provision was made to identify the 
individual completing the questionnaire ^ it was impossible to do a corre- 
lated t test on the data available, For these reasons 5 the results of 
the Center programj particularly as presented statistically in Table 2 5 
must be termed inconclusive. 

Table 2 

Comparison of Scores on Content Questionnaires 





Number 
of Items 


N 


Mean Nmber 
Correct 


S * D , 




Alcoholism 
Pretest 
Posttest 


5 
5 


10 
10 


3.60, 
3.60^ 


0,80 
1.10 


0.00 


Communications 
Pretest 
Posttest 


6 

D 


6 
5 


U.OO 


1.15 
0.00 


1.9^ 


Consimier Affair 
Pretest 
Posttest 


B 

8 
8 


3k 

26 


5.82 
5^92 


1.29 
1.27 


p. 29 


Venereal Diseas 
Pretest 
Posttest 


e 

6 


19 
17 




1.63 


O.2U 


Welfare Rights 
Pretest 
Posttest 


7 

7 


50 
1+5 


h.6o 
5,80 


i.ko 
1,11 




*p<.Ol 












However ^ ci 


srtain observations 


may be made rei 


yarding the 


apparent 


implications of 


the data. Fir 


^st^ it would appear 


that those 


workshops 



and assemblies that were offered had little or no effect on the parti- 



cipants. In only one case^ that of the welfare righLs questionnaire, 
wez^e the results statistically si^ificant^ and here the population was 
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only fifty persons* Since it was the evalmtor's observation that the 
workshops/assemblies were generaUy informative and on the intelligence 
and interest level of those in attendance, a possible e^^lwiatlon for 
these relatively poor results may be the nature of the original instru- 
ment* In most casas, the number of items was so few that obtaining re- 
liable results all but precluded. In addition^ while the guest pre- 
sentations were valuable ^ little or no attempt was made to specifically 
apprise the guests, of what was expected of them, Thus^ the original 
questionnaire did not always parallel the material presented; i.e., 
they were not criterion-referenced examinations- 

In this regard, it is interesting to note the results of the one 
revised questionnaire that was administered ^ that on drug abuse* The . 
data from 83 participants is presented in Table 3. Unfortunately^ only 
the poattest was given. However ^ it is significant that the level of 
mastery specified in the evaltiation design - seventy-five per cent of 
the participants giving correct responses to slxty-'five per cent of the 
items - was achieved. Assuming the validity of the instrument , this 
would seem to indicate that^ at least in the area of student education 
in drug abuse, the Center prograjn is achieving its objectives. 

Table 3 

Per Cent of Items Answered Correctly by Respondents 
to Questionnaire on Drug Abuse 





Per Cent Correct 




Cujnmulative N 


& 


Cinnmulativa 


Above 85 


5 


5 


6 


6 


75 - 8h 


26 


31 


31 


37 


65 - 71+ 


■ 32 


63 


39 


76 


Below 65 


20 


83 


■ 2k 


100 
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V. PROGRAM SraENGTHS 

In concluiion^ several qmlitative strengths of the program deserve 
mention* Firsts the ability and dedication of the coordinator and her 
staff were uniformly high. They brought an apparent e^ertise in manage- 
ment skills to the project ^ as well as a thorough knowledge of the com- 
munity in which they work. Second , there was a needed flexibility to 
the program^ which allowed the Center to adapt to the information needs 
of their constituency. Third , the Center Coordinator and staff estab- 
lished eKcellent rapport with the school administrations and public and 
private agencies with which It cooperated, Just as signif icajntly, the 
prograjn personnel showed an ability to select agencies that were both 
capable of high quality presentations and active within the commimity* 
Finally^ both the Center staff and the guest speakers seemed aware and 
capable of producing the "home" atmosphere necessary to help parents 
relax in what may be an "alien" institution for them, 

VI , RECOi#ffiroATIONB 

The following suggestions are designed tg h^]p proYlde the quanti- 
tative data to support what appears by observation to be a successful^ 
quality programs 

1. Greater effort must be made to adininister the various question- 
naires to all prograjn participants, especially the students. If reading 
problems make this difficulty the questions might be administered orally^ 
with pupils simply marking one of the three boxes next to the pertinent 
niamber* This reconmiendation was also made in the interim report ^ but 
appears to have, gone unheedecl, 

2, In addition to questionnaires which test knowledge acquisition, 
gome attempt should be made to systematically san^le the participant's 
opinions of the presentation itself. This would provide a second meas-^ 
ure of the effectiveness of the workshop and/or assembly. 
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3* When enough questionnaires have been Goinp].eted to yield reliabl 
results 3 this data should he used to ascertain what type of format (as- 
sembly, small group workshops a combination of the two^ etc) is most 
effective for each of the content areas* If possible^ the importance 
of audio-visual presentations and/or the distribution of printed litera= 
tvire should also be determined. 

Guest speakers should be apprised of the specific objectives 
of the Center program in their area* One means of doing this might be 
to shovr and discuss the pertinent questionnaire with them. 
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i , 

"STUDENT PROGRESS REPORTER CORPS" 
Prepared by- Leonard P. Stocker 
I, INTRODUCTION 

The programj "Student Progress Reporter Corps 5" was in operation 
during the 1974-1975 school year in fotir puhlic schools of New York City 
Three of these schools were located in Manhattan's Coiflmunity School Dis- 
trict 3? while the fourth school was in Connnunity School District 23 of 
Queens . 

Directly involved in the program were USO children in grades two 
to six whose reading scores were found to he considerably below the mean 
for their grade. In many cases this was two or more years, A remedial 
program was introduced to bring about an improvement in the children's 
reading skills* In two of the schools in the program some of the mater- 
ials provided through Student Progress Reporter Corps funding were made 
available to children other than those directl^r participating in the 
project. 

The program had as its primary objective the raising ^ to a statis- 
tically significant degree 5 of tha reading achievement .^feapes of the 
pupil participants. Another objective of the program was to increase 
the children's motivation, 
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deiired improvements were to be ■brought about by meang of speGial 
and inteniified instructidn provided by reading teachers aided by paja^ 
profeSBionalSg and through the use of special equipment (Betti-Kits 
and New Century Audio Access machines and materials). 

The extent of the improvement In the children's reading skills vas 
measured by the degree of the chejige that too^ place in pre- and post- 
treatment reading scores. 

II, EVALUATION DESIGN 

Visits to the four schools involved in the program were made by the 
evaluator during the school year for the purpose of observing the program 
in its day-to-day operations. On these occasions interviews were held 
with the principals of the four schools^ several of the assistant prin- 
cipals, the coordinator of the program, the teachers of the children ^ 
the paraprofessionals involved in the project ^ as well as a sajnpling of 
the pupils in each school in order to obtain their reaction to the pro- 
gram in which they were participants. 

Pertinent records of the pro.iect's coordinator and those of the 
four schools coneerning the children in the progrMi were readily made 
available to the evaluator , were examined by him 5 and found to be in good 
order* 

The Spring 197^ I4AT Reading Subtest Grade Equivalent Scores were 
used for the pre-treatment scores g while the Spring 1975 N<Y*C* Reading 
Comprehension Grade Equivalent Scores served as the post-treatment scores. 
The expected post -treatment scores were determined by historiGal ^regres- 
iion analysis of the Aprils 197^+ pre-treatment scores. The significance 
of differences between the e^qpected and the actual achievement were de- 
termined by a correlated t test, 
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III, PROGRM lOTIEMENrnTION 
The present project, supported through Umbrella funds 5 has completed 
its third year of operation* Partioipating in the prograjn in the 197^-- 
1975 school year were the following schools 1 

P,S, 107Q - 167th Street and ^5th Avenue ^ Queens, District 25 
P,S. I8OM - 120th Street ajid Majihattan Avenue, Manhattaai, District 3 
P,S, 207M - Ul West 117th Street, Manhattan, District 3 
P,S* 208M " 21 West 111th Street, Manhattan, District 3 
For reasons which will be indicated below, two schools (th&t on 
Roosevelt Island and P,S. 113M) were not included in the present program* 
The New Century System 

Each of the children of District 3 participating in the program 
came for a period of kO minutes daily to the special reading laboratory 
in each of the District's three participating schools to receive assls= 
tanee in improving his reading skills* These three schools used the 
New Century Audio vrrlte-and=See Instruction System, (B*F, Skinner, it 
may be noted in passing, served as advisor In the development of the 
New Century curriculum and materials.) 

The New Century curriculum is designed to ensure the pupil -a con- 
tinuous progress and his daily success by the manner in which lessons 
are sequenced, Goupled with a variety of highly motivating procedures 
together with additional reinforcement provided by the personal approval 
of the teacher and her aides. The program provides not only for continual 
diagnosis of the pupil's performance^ but also prescribes specific Instruc- 
tions that will help overcome the child *s particular problems. The sys- 
tem, in addition, also gives rise to immediate reinforcement of desired 
learning behaviors. 

The New Century System Is complete and comprehensive* It Is geared 
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to the developmejnt of the full range of reading skilli - word attack, 
vocabulary^ auditory and compreheniionj as well as study skills. 

Most of the materials, the teachers and children reported, were of 
a fairly high interest level. They were constructed in such a manner 
that correct responses were immediately reinforced* Diagnostic instru- 
ments for the measurement of reading deficiencies were incorporated 
into the prograjn so that each child could be placed at an appropriate 
level and thereupon ^ at his owa pace, follow a progr^ that was largely 
individualized . 

The system begins with the development of such pre-reading skills 
as visual and oral descrimination, the development of such concepts aa 
sequence 5 size, and polarity. The child may then advance to decoding, 
and the establishment of sound-sjnribol correspondences between the printed 
and spoken words. Next, from simple words and sentences the child gradu- 
ally progresses to ever more difficult sentences ^ paragraphs, and stories. 

Two devlees are used to individualize the teaching process* the 
Audio Frame and the Write-and-See systems. 

The Audio Frame system is a cassette playback machine that is used 
with earphones. The machine is placed in a carrel which has sides and 
thus provides the pupil with a measiire of privacy* The child receives 
specific and detailed instructions for each lesson through the headset. 
The machine then stops to provide the child with an opportimity to re- 
spond , When the child is ready for the next audio presentation^ he 
presses a button on the Tnaohine and hears the next audio presentation, 
makes his next response, and so on ujitil he completes the lesson. 

Used in conjunction with the Audio Frame machine are the Write- 
and-See materials* When the teaching tape requires a response from the 
pupil, he makes a mark in the appropriate box on the answer page with a 
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special felt^tlp 'marker . If the correct response ms chosen, a striped 
pattern is revealed, "but if a wong ansver was selected no striped pat- 
tern appears in the hex he has marked. Thus the child knows iiranediately 
if his response is correct or not. The Write-and-^See system makes it 
possible for the teacher to evaluate each pupil's work by merely glanc- 
ing at the response sheet and noting the number and kind of problems the 
child has had with the lesson. She is then in a position to decide what 
prescriptive action is appropriate to meet the particular needs of each 
child. 

The level at which the child comes into the system is determined 
by a placement test. Each pupil in the program has a folder which stores 
hii response sheets and a series of recording grids , one for each portion 
of the curricula. The results of the placement test are entered on the 
proper grid , the results of each diagnostic test are indicated ^ and the 
score the pupil achieves for each lesson is recorded in the proper place 
on the scoring grid. It Is thus possible to tell at a glance where the 
child should be working in the cinrriculum and how well he is doing. In 
addition^ a weekly report is compiled to record the Gompetence points 
each pupil has accumulated. 

Each time a pupil has acquired 30 competence points he has his pic- 
ture taken with a Polaroid camera and receives a color photo of himself. 

To provide additional motivation for the children to advance to 
higher levels in the progrraij certificates of merit of increasing size 
are given to children as they progress from one level to another. There 
are 5 in all^ eight such levels. 
The Betti-Kit Materials 

Much less elaborate than the New Century system^ are the Betti-Kit 
materials that were used in P,B. 107 in Queens, They consist simply of 
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special workbooks which are ge^ed to he used with special tapes* The 
latter are played for an entire class on tape decks provided by the 
school. The children^ seated at their desks in their regular classrooms^ 
attainpt to mark the correct answers in their workbooks. The teachers 
and aides go from desk to desk^ make corrections and atten^t to follow 
the progress of the children* 
P.S. 207M 

Located in P,S. 207 ^ ^-1- West 117th Street ^ Manhattan is the teacher 
coordinator of the entire project as well as a part-time tj^ist who serves 
as secretary and aids the program^ s coordinator in his work. 

The Reading Laboratory at P,S. 207 is located in a bright ^ cheery 
room that houses 23 carrels . In charge of the operation here is an ex- 
perienced reading teacher who has had more than 20 years of service in 
New York City schools. She is assisted by two full-time educational as- 
sistants* Participating in the prograjn were lOU children coming from 
eight classes in grades four and five* 

The second District 3 school in the prograjn was P*S* 208 located 
at 25 West 111th Street, In this' school II8 children in grades three , 
four 3 five 5 amd six were aided in their efforts to improve their reading 
by one full-time teacher and two paraprofesslonals . The teacher who was 
in charge of the Reading Laboratory has been at P,S* 208 for 5 years | 
this is her second year with the Reading Laboratory* One of the educa= 
tional aides who assists her has been with the program for 3 years ^ while 
the second paraprofessional is completing her first year with the Reading 
Lab* 

.At P,S* 208 the Reading Laboratory is commodiously housed in two 
adjoining classrooms ^ both of which are well lighted and bright* In on* 
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of the rooms there are 32 carrelis each equipped mth a headset and cas* 
sette player. In the .second room there are additional cassette player s, 
as well as chairs ^ desks and tables at which' the children can work at 
specially assigned tasks under the superviiion of a teacher or a parapro- 
f essional, 
P,S. 180M 

At P.S* 180 5 120th Street and fcnhattan Avenue 3 97 children from 
grades three, four 5 and five have participated in the school* s special 
reading program. Here the Reading Lahoratory^ with 28 carrels 5 has "been 
in operation since September ^ 1970 under the direction of the teacher who 
is. presently in charge. She has had more than 25 years of teaching ex- 
perience in New York City schools. She is aeiisted by one aide, who has 
been with the program since its inception in 1970* 

A unique featiare of the progrM in this school is that the partici- 
pating pupils are not assigned to the Reading Laboratory periods on the 
basis of their classes of origin^ but rather to periods in the Reading 
Lab that deal with the remediation of specific reading problems* Thus 
in a given period there may be thirdj fourth^ and fifth graders in the 
Lab all of whom are receiving help in somewhat similar reading problems 
they might be having, 
P.S, 107Q 

The New Century system £.nd materials were not in use at P*S* 107? 
Queens in District 25 • In this schoolj six of the regular classroom 
teachers were assisted by three paraprofessionals^ working within the 
normal classroom struotinre^ to improve the reading skills of 122 children 
by means of Betti^Kits. As previously indlGatedi the Bettl-Klt materials 
are simply tapes that are played for an entire class at one time while 
the children at their classroom desks use workbooks that have been devised 
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to be uaed in conjimction with the tapes. The Batti-Kit program ms in 
oparation for the second year at P.S. 107* Project "Student Progress 
Reporter Corps" provided funds in this school only for the Betti-Kit 
materials ($^5800) a^d for the salaries of the three paraprofessionals 
($153200) associated with the program. 
Facilities - Materials - Equipment 

The school rooms housing the New Century carrels 5 equipment, and 
niaterials were in all cases bright^ roomy^ and cheerful so that a satis- 
factory learning clijnate was provided in the Reading Laboratories for 
the children of P.S. I8O5 207 5 and 208 who participated in the program* 

In these three schools the Reading Lab personnel stated that all 
of the required printed materials were available in ajnple supply at all ^ 
times. The program thus did not suffer at ajiy time from interruptions 
for lack of materials* 

According to both the project's eoordinator and the reading teachers 
In the Individual schools, the hardware used in the program was well con= 
structed and needed infrequent servicing. In the few instances when this 
was necessary 3 standby units were available , repairs were made prompt^y^j 
and the original equipment was back In use without delay so that no in- 
convenience or disruption were encountered because of equipment failure. 

In one of the schools , however, it was reported that the effective- 
ness of the New Century program was slightly marred because some of the 
ajiswer sheets ^ apparently because of age, showed the correct response to 
the child even before the felt-tip marker was applied to the answer page. 

Minor ob.jections were also raised by a few of the teachers to the 
quality of some of the art work in the New Century materials . Some of 
the drawings 5 it was said^ were not as clear and unambiguous as they 
might be and could thus confuse the child , 
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The audio quality of the New Century cassettes wai judged to be good* 
It -was noted ^ however ^ that it was unduly difficult at times - because 
of the quality of either the tapes or that of the playback equipment = 
to understand what was being said on the Bettl-Kit tapes* It might also 
be reported that the general appearance and layout of the Betti-Kit work= 
books were not partiGularly attractive. 
Changes in the Program 

In an addendum to State Umbrella Programj 197^-1975 involving the 
Students Progress Reporter Corps ^ the coordinator of the program on 
March IS, 1975 requested the following changes^ 

1, To reduce the number of participants f^om I5OOO to 

2, To delete P,S. 113 from' the budget ^ because it is not being 
implemented at the present time. 

The reasons cited in Justification of the ehangea were: 

1, II is necessary to reduce the number of participants due to the 
fact that this program previously included the participants of the Goddard 
Riverside Educational Camp Program which is now a separate program (Func- 
tion # 2O-53U28) md alsOj due to the theft of materials and equipment 

at P.S. 113 5 the program has not been operating at that location, 

2. Because of insufficient funds it has not been possible to re- 
place stolen items* 

The requested changes were duly approved by the appropriate officials 
of the City-Wide Umbrella Bureau^ the Umbrella Supportive Bureau, the 
Office of Funded Programs 5 and the Division of Community School District 
Affairs , 

* 

Problems in Implementation of Program 

- The "Student Progress Reporter Corps" program, fortunately^ was not 
afflicted with' major problems of implementation. It should ^ however, be 
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noted that, at P.S, 20?^ the installation of the carrels in the Reading 
Laboratory of that ichool wai cOTpleted only in UoYember^ 197^^, The full 
remedial reading prograai of the echoolj aGcordlng]^, got miderway eoniawhat 
belatedly, 

IV* raOGRAM EPPECTB^MISS 

The effectlveneee of the program in the individual ichools will be 
obvious trom the following tables which present (a) the icorea obtained 
by the children in the prograjii in Spring 197^^ (b) the scores that they 
were predicted to attain a year later, and (c) the scores they actually 
did obtain in April, 1975- 

It la to be noted that for all four sehoole the numL.er of children 
for whom both pre-treatment (MAT Reading Score for Spring I97U) a^d poit- 
treatmf^nt (N,Y,C. Reading Comprehension) scores were available Is smaller 
In each instance than the total number of children in the schools' special 
reading program. 

Table 1 

Pre-Test Means, Predicted Post^Test Means , and Actual Post-Test Means 

(P.B. I07ft) 
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Grade 


N 


Pretest 
Mean S.D. 


Predicted 
Mean 


Posttest 
S,D. 


Actual 
Mean 


Posttest 
S.D. 


t 


3 


20 


2.06 


.19 


£.1+7 


.27 


2.80 


.3U 


k . Blh** 


k 


17 


2.71 


.39 


3.13 




U.O8 


.95 


k , 807** 


3 


^7 


3.69 


.66 


h.22 


.80 


k.B3 


1.18 


h , 90U** 


6 




5.05 


.85 


5.69 


.98 


5.58 


.96 


-0.532 



*slgnlf leant at .05 level 
NO^: The negative t value indicated that the Actual Posttest Mean 
was less than the Predicted Posttest Mean, 

The actual mean reading score of the children in grades, three, four 

and five surpr jed the predicted mean scores by three months ^ one year^ and 

seven months, respectively* The children, accordingly, were either at or 

very close to the normal grade level. 113 



Table 2 



Pre-Test Meajia, Predloted Post-Test Means, and Actml Post-Test Means 

(P.S. 180M) 



Grade 


N 


Pretest 
-VMeaii S.D, 


Predicted Posttest 
Uem S.D. 


Actml 'Posttest 
Mean S.D. 


t 


3 


25 


2.i+l 0.50 


2.93 


0.71 


3.02 


0.53 


0.821 


1^ 


32 


2.9^ 0.56 




o.n 




0.68 


p. ^19 


5 


23 


. 3.75 0.51 


h.SO 


0,61 


3.6a 


1.0!l+. 


-2.709* 



NOTE- The negative t value Indicated =that the Actual Pos-ttest mean 
was less than the Predicted Posttest mean. 

The third grade children in this Reading mhoratory, the table 
indicates, slightly surpassed the predicted mean score, while the fourth 
graders equalled it, and the fifth graders fell somewhat short of it. 

Table 3 

Pre-Test Means, Predicted Post-Tpst Means, and Actual Post-Test Means 

(P.S. ZOfU) 



Grade 


N 


Pretest 
Mean S.D. 


Predicted PoBttest 
Mean S.D. - 


Actual 
Mean 


- 

Posttest 
S.D. - 


t- - ■ 


1+ 

5 


1^5 
1^3 


2.hk 0.56 
2.69 0.56 


2.81 

3.02 


0.70 
0.67 


3.00 
3.26 


0.60 
0.83 


2.060* 



^significant at ,05 level 



The actual mean score of "both grades iurpasied their predicted mean 
scores by 2 months* In considering these scores it should "be recalled 
that the Reading I^b at F,S. £07? because of the belated installation 
of its carrels 5 started to function only in November, 197^ rather thaii 
at the beginning of the school year. 
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Table k . , 

Pre-Test Means, Predicted Post-Test MeaJis, and Actual Post-Test Means 

(P.S. 208m) 



Grade 


N 


Pretest 
Mean S . D . 


K-edlcted 
Mean 


Posttest 
S.D. 


Actual pQffttoBt 
Mean S.D. 


t 


3 


26 


' 1.96 


0. 76 


2.12 


0.23 


2.07 


0.1*7 


-0.629 


k 


29 


2.37 


0.35 


2.73 


0.k3 


a. 92 


0.71 


1.358 


5 


28 


2.85 


OM 


3.18 


0.59 


3.69 


1.11 


2.639* 


6 


26 


3.75 


0.88 


U.18 


1.02 


it. 35 


0.99 


.721 



^significant at ,05 level EOTEi The negative t value indicated 



that the Actual Posttest mean was 
less than the Predicted Posttest mean. 
In P.S, 208 the actual mean score of the pupils in. the third grade 

was one month short of the predicted- mean score ^ while the fourth and 

fifth graders surpassed their predicted mean scores by 2 and 5 months 

respectively* 

To some degree , children participating in the prograjn have sho™ 
progress considerably beyond that which would have been e^^ected in the 
light of their achievement prior to enrolMent in the program. This was 
particularly true at grades 3, ^ and 5 'in P.S, 107Qs at the fourth grade 
level in P.S, 207M, and at the fifth grade level in P.S* 20^1, Obtained 
results at P.S, iSOMj however ^ were disappointing. 
Motivation of the Pupil Participants 

It was noted repeatedly by the evaluator that most of the children 
participating in the New Centiiry program were m%±ouB to get into the 
Reading Laboratories of their schools at the beginning of thy class peri- 
ods and many of them lingereu on at the end of each period* Ihey obvl- 
ouily enjoyed being there. Judging by the information elicited from the 
children during infomal interviews that were held with them, it is clear 
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that they liked their work and felt that they were profiting hy their 
pa^tieipation in the activities of the Reading Laboratory* 

Questionnaires dealing with the motivation and attitude o^bhe pupil 
toward school which were completed by principals and teachers indicated 
that the pupils who participated in the program seemed for the most part 
to be happy and relaxed* On the basis of the respongas received^ the 
following statements can be made: 

1* Aljaost without exception^ the children worked independently 
without undue attention. 

2. After working in the prograjn for even a short while the major- 
ity of the pupils felt confident of their ability to succeed. 

3* Most took coniiderable pride in their work* 

Probably because of the manner in which the progrM was designed 
and conducted frustration was found to be virtually noh-eKistent * 

5. Teacher assistance and help were eagerly sought when the chil- 
d_ren encoimtered difficulties they were imable to overcome by themselves* 

6. There was virtually no inappropriate behavior in the reading 
classes , 

7. The children were a highly attentive group. 

8* They patently obtained a great deal of satisfaction from their 
work in the Reading Laboratory* 

9* There was hardly anyone who did not participate enthusiastically 
in the activities of the Lab* 

¥, STOENGTHS ATO- TOIAIOJESSES OF PROGRAM 

No major weaknesses were noted in the progrMis in effect in the 
three Manhattan schools using the New Century system. 

The principals of the schools involved in the project were highly 
supportive and thus contrlbitted to the success of the operation* The 
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reading recordi at the coordlnater * s office as well as at the individual 
schools seem to be complete and in good order. The teachers as well ag 
their assigtants appear to he capable^ dedicated to their tasks ^nd con- 
scientious in the performance of their duties. 

The New Centiary program is favorably viewed by school personnel 
for it is felt that it does help the children in the program to make 
considerable progress in the mastery of new reading skills. TOiii is done 
at the child *s own pace and without embajassment by possible failwe in 
the presence of the child -s peers or his teachers. Distractions j too 5 
are largely eliminated by the msmner in which the system has been de- 
signed. In addition^ the motivation to succeed aiid advance to ever 
higher levels of reading accOTplishment has been effectively incorporated 
into the prograjn. 

Teachers using the Betti-Kits were less pleased with these matarials. 
It TOS reported that the interest of the children tended to fall off and 
the pupils seemed to become somewhat bored* The teachers at P,S. 107 
were also of the opinion that their work would have been more effective 
had it been possible for them to devote more individual attention to the 
children in their reading classes , 

VI. RECOMbffiNMTIONS 

It is evident^ on the basis of the available test data^ observations 
and Interviews with program personnelj that the program merits recycling. 
The following suggestions are offered for consideration. 

1, It would be helpful if the teachers in charge of the Reading 
Laboratories could meet several times during the coiarse of the school 
year to discuss the problems they encounter in the teaching of reading, 

2, It Is recommended that a more .individualized approach be used 
in the future to either supplement or replace Betti-Klt materials. 
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3- It would be helpful In groups using the New Centxiffy syitem to 
develop some homework materiali that the children could take home with 
them and there ^ in the after-school hoi^e, reinforce the learning that 
has taken place at school e^ller in the day. 

Additional hlographlcal imterlal that is highly relevant to the 
children using the New Century program would he of considerably value in 
motivating children and thus assisting them to overcOTie their reading 
deficiencies* 

5, The publishers of the New Century materials should be encouraged 
to improve the quality of some of the line drawings used In their materials 
In some Instances it Is not at all certain precisely what Is being shown 
in the pictures on the mswer sheets and in the workbooks. 



118 



SCHOOL CP mUCATION 
mSTITOEE] FOR RES^CH MB VALUATION 



Final Report Function No* 20-53^^1? 

July, 1975 

EVALimTI^ OF CITr-Wn)l IlffiRELLA EROGEAMS 
-NEW YORK CITY BOMB OF IDUCATION 
I97U - 1975 SCHOOL YE^ 

CHILDREN mRN TO RE^ TmOUGH COOMMTrV^ lEACHING OF 
PARAPROFESSIOMLS AND ^CEEES" 

Prepared by* Regis BerrAajfdt 

LnMlian Levinej 
Research Aisistant 

I, INmODUCTICW 

This prograin was designed, to provide diagnostic and prescriptive 
reading instruction for six h"undred children in P.S. 327, The target 
population included children in grades 3 through 6 who were reading be- 
low grade level as measured by stajidardiEed reading tests. The program 
provided materials for classroom reading instruction and for a reading 
laboratory^ and paraprof essionals to staff the laboratory and to assist 
classroom teachers, 

^e program was originally begun in the school during the ig68- 
1969 school year. Throughout the period of time the program was in op- 
eration, paraprof essionals were provided to assist classroom teachers, 
Tiie Open Court reading program was used to supplement the district-wide 
reading prograja* Findings from previous evaluations of the school -s 
funded programs Indicated that the ^en Court prograjn was more effecti/e 
than the Basal Reading program by Itself for chiliflren in the school. 
However 3 the staff found that children who had attained the fourth grade 
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level in Open Court had difficulty with fifth grade Open Court materials. 
Houghton Mifflin mterials were suTsstituted for the latter at the sugges- 
tion of the reading resource teftoher. During the l97it-1975 school year, 
materials in the RtJidom Houie Systems were addea as a supplement to bhe 
progi'am. These materials ware to ■be used as one element of the readi.nt 
laboratory. 

II. PHOGRAM EVALUATION 
The two otj act Ives for the program as stated in the prograjn proposal 



were : 



1. The target population will demonstrate a significant increase 
beyond expectation in reading achievement as measured hy the Gilmore 

Oral Reading Test . 

2. Community paraprofessionals will demonstrate a level of adequate 
or better performance as measured by locally developed standards. 

The Gilinore Oral Reading Test was administered by prbgrim personnel 
to 150 target population children. Results of the Metropolitan Achieve- 
ment Tests from April, 197^, were utilised as pretest scores for the 
other children receiving Umbrella ftogram services. The first group 
of children were those who received the Umbrella program services, while 
the second included those who also received Title I servicec. The Gilinore 
Test was readministered by program personnel in May, 1975. ReEilts of 
the City-wide achievement testing program were used as the posttest for 
the other group. Conversion tables, made available by the Office of 
Educational Evaluation, were used to enable a test of the statistical 
significance of differences between the City-wide test results. Compar- 
Isons between pretest and posttest results were made utilizing historical 
regression procedures wherever appropriate. The con^arisons were between 
the Reading sabtest of the and the Reading Comprehension subtest 
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of the New York City Tait, 

To evaluate the ssGond progrMi objective 5 related to the perfoMia^ee 
of the paraprofeSBionals 5 a questionnaire "based on local standards tos 
developed. The questionnaire contained items concerning the iervices 
and i^mctions performed by the pajfaprofessionals . Administratori and 
teachers who worked with the paraprofeiilonals were asked to canplete 
the queitionnaires rating the performance they had ohserved during the 
yea^, Para^ofessionals were asked to complete a questionnaire designed 
to obtain information concerning their perceptions of the program* 

Observations were made of the alassroom settings where paraprofes= 
sionals were assigned^ and of reading lab sessions* 

III, moGRMA mpUEwrmTiON 

The principal of the school served as the program coordinator. In 
this role the principal was responsible for the administrative aspects 
of the progr^ as well as for providing instructional leadership. Assis- 
tance in the latter responsibility was provided by the school^ s reading 
resource teacher 5 who coordinated the reading activities in the classrooms 
and reading lab. The classroom teachers who worked with the paraprofes- 
sionals and program materials were supported by tax-levy funds as were 
the above mentioned personnel. 

Seven paraprofesslonals were provided through the Umbrella program. 
Their assignment was on a full time basis 5 five and one half hoijrs-per 
day 3 five days per week. Five parapr of es sionals were assigned to assist 
classroom teachers 5 while the remaining two were assigned to the reading 
lab. 

The program provided a part-^time secretary who worked at the school 
one day per week. She did not have specific duties but was used to give 
assietance wherever needed. This arrangement was followed because regular 
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seGretarlal staff were utlli^ad to iervlce the program in areas beet 

provided for by full-tiifle periormel or vhen the prograjn-supported-Sec- 

reta^y mi not present. For esan^le, the payroll iecretary maintained 

the records for the paraprof essionals in order to provide contintiity to 

the records on a daily rather than a weekly basis. The program- supported 

secretly 5 in turn^ assisted the regular secreta^iee with their duties. 

Several prograjn changes from the original design occurred during 

the year. The principal of the school reported that| because of a decline 

in school enrollment and the number of children who received services ftom 

other funded programs in operation in the school^ fewer than the Intended 

600 children received Unbrella Program services, A written program ad- 

dendumt had been filed with appropriate offices of the Central Board of 

Education which stated that 300 children were enrolled In the program. 

Of this nimber, 150 received Title I program services as well as Umbrella 

Krogram services , 

The reading lab did not begin In the fall as had been planned. The 
f 

principal stated that final approval of fmding for the program tos not 
obtained until the fall^ and materials were ordered Immediately after 
approval was granted. Materials essential to operation of the lab were 
received during the winter months. The lab began full operation the week 
of February 17, Orientation visits of the classes that utilised the lab 
were made during the two week period preceding the starting date* The 
purpose of these visits was to familiarize the teachers^s. paraprofesslonals 
and children with the lab materials and procedures . 

The paraprofesslonals assigned to work with classroom teachers 
functioned In these settings from the beginning of the year. They assis- 
ted the teachers by providing opportunities for small group and Indivi- 

dualized Instruction in reading and related areas. 
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Prior to the time the lah became ready for operation g the two para- 
prof esslonals assigned to work there were iitilized for a variety of tasks. 
They administered the GiMore Oral Reading Test to the target population 
children* As materials for the lah arrived, they prepared it for use, 
and the reading resource teacher used the time to train them in the use 
of the materials >nd equipment. As part of the training process 5 the 
principalj reading reiource teacher, and paraprofesslonals visited read- 
Ing lahs in other schools , The two paraprofessionals were also used in 
regular classroom settings at times. 

The lab was located in two rooms in the school, toe room housed 
software materials, while the other contained audio-visual equipment and 
materials , 

Five classes came to the lab each day. One group of classes^ which 
inclxided children primarily receiving Umbrella Program services, ms as- 
signed to visit the lab on Mondays, Wednesdays and Fridays, The other 
group of classes, which included children who also received services 
from Title I programs, attended the lab sessions on Tuesdays and Thws- 
days. The time of day the classes were scheduled to go to the lab varied 
so that the same group was not always first or last each day. Lab sessions 
were forty-five minutes in length. Teachers Bjai paraprofesslonals accom- 
panied the classes to the lab and remained with the children during the 
lab period, - 

The principal reported that the reading resource teacher was very 
well qualified to assist In the program. Because of her training and 
her f Mil liar Ity with the Random House system, It was not necessary to 
hire a consultant from the company to train teachers and paraprofesslonals 
to work with the materials e^d equipment. 

The teachers and paraprofessionals were asked to rate various aspects 
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of the program. Ratings were obtained from both the reading laboratory 
ajid the classroom eettings. Reiiilts of the rating process ^ presented in 
Table I5 were all at least "very good" (3*5 or above). Facilitieii materi- 
als and equipment were stated to be suitable and sufficient. Supportive 
servicei of administrators and paraprofessionals as well ai training pro- 
vided to staff were rated high* Finally 5 benefits obtained by children 
in the areas of attitudes 5 behavior and learning ^ were all perceived as 
positive. 

Table 1 ^ 

Staff Ratings of Various Aspects of the Bfogram 





Areas 


Lab 
Mem S.D. 


Class 
Mean 


jroom 
-k) 


1. 


Suitability of physical facilities 


h.37 


.k9 


3.75 


.43 


2. 


Suitability of avalla'ble materials 




.35 


3.75 


.83- 


3. 


Availability of materials 


k.37 


.kg 


k.OO 


.71 


k. 


SufflGiency of mate' lals 


k.hs 


M 


3.50 


.50 


5. 


Suitability of available equipment 


k.71 




J+.25 


.k% 


6. 


Availability of equipment 


h.37 


M 


k.OO 


.71 


' 7. 


Sufficiency of equipment 


kM 


.k9 


3.75 




8. 


Supportive services provided by 
administrative personnel 


kM 


.35 


I+.25 


M 


9. 


Training provided 


3.71 


1.16 


k.OO 


.71 


10. 


Assistance of paa'aprofessionalB 


1^.71 


M 


k.75 


.U3 


11. 


Positive effect on pupils' learning 


i+.33* 


M 


k.30 


.50 


12. 


Positive effect on pupils ' behavior 


k,lk 


.35 


k,30 


.50 


13. 


Positive effect on pupils' attitudes 
toward self 


3.86 


.6k 


k,30 


.50 


li;. 


Positive effect on pupils' attitudes 
toward school 


3.83* 


.69 


k.30 


.50 
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IV, PROGRAM EFFECTCTINISS 

As previously stated, the major prograjn objective tos that children 
would demonstrate a significant increases beyond expectation ^ in reading 
achievement. The Gllmore Oral Reading Test tos administered by program 
personnel to the I50 children who received Umbrella Program services in 
the Fall of 197^ and again in May, 1975. In addition, the Reading sub- 
test score of the Metropolitan Achievement Test of April, I97U3 wae used 
as a pre-test score for all 300 program participants j and the April, 1975 
Reading Comprehension subtest of the New York City Test was used as the 
posttest score. Historical regression procedures were utilised to deter- 
mine predicted posttest scores for the particlpajits. Conversion tables 
provided by the Office of Educational Evaluation were used to convert 
N.Y,C* Reading Comprehension Scores to MAT grade- equivalents. Pretest 
and posttest means were compared on a grade -by-grade basis through use 
of a correlated t test. 

Results of the comparison of the Giljnore Test scores are presented 
in Table 2, 

Table 2 

Coir^arison of Predicted and Observed Posttest Means 
of I^ogram Participants on the Giljiiore teal Reading Test 



detest Predicted Posttest Observed Posttest 

Grade N Mean S,D. Mean S.D, Mean S,D, t 

3 63 ■ 3.19 1.77 3,7k 2,20 k,70 2.2h h.2Q^^ 

^ 26 3*73 0.77 i+.50 1.02 U.95 0,97 3.05^-^^ 

5 18 kM 1.15 k,75 1.37 6,26 1.78 5M^^ 
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The meajis of the observed postteet saores for the three grades on 
the Gilmore Test were aignif icantl^ greater than the meajis of the pre- 
dicted scores* The observed mean grade equivalent at the third grade 
level was one full year greater than the mean predicted grade equival^ 
ent* At the fifth grade level the observed mean grade equivalent was 
a year and five months greater than the mean predicted grade equivalent. 

The predicted BjnA observed posttest MAT scores of this seme group of 
program participants were compared^ and the results are presented in Table 3» 

Table 3 

Comparison of Predicted smd Observed Posttest Means 
of Program Participants on the Metropolltaji Achievement Test: 
Umbrella ^ograjn Treatment Only 



Pretest Predicted Posttest Observed Posttest 
Grade N Mean S.D, Mean S,D, Mean S.D, t 

3 63 2-85 1,23 3,57 1.72 2.91 0,73 -^,13** 
k 26 2.78 0.55 3,25 0,68 SM 0.51 1.6$ 
5 19 3.36 0,76 3,82 0.91 ^.68 1,00 6.1k^^ 

NOM: The negative t value indicated that the observed posttest mean 
was less thanthe predicted posttest mean, 
/ . 01 

The children's performajice on the Metropolitan Achievement Test was 
not consistent with that on the Gitoore Test, While the observed posttest 
meaii grade equivalent score of third grade children on the QUMorm Tmt 
far exceeded the predicted posttest mean, on the MAT, the observed means on 
posttest was significantly less than that predicted. At the fourth grade 
level no significant difference was found between the predicted and ob^ 
served MAT posttest means. Performance of fifth grade children on the 
was more consistent with the GiMore than for the other two grades. 
The observed posttest mean was significantly greater than that predicted 
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on "both stajidardlzed tests* 

Acaclemic achievement of children who received Umbrella program reading 
laboratory services, but who received claseroom iervices from Title 1 
paraprofessionalsj was al i examined. Results of the comparison of their 
predicted ajid observed MAT posttest resu_lts are presented in Table 

Table h 

Comparison of Predicted and Observed Posttest Means 
of Program Pajrticipants on the Metropolitan Achievement Test 
and N.Y.C, Achievement Test: Umbrella Reading Lab Services 







Pretest 


Predicted 


Posttest ' 


Cbserved 


Posttest 




Grade 


N 


Mean 


S.D, 


Meaji 


S.D. 


Mean 


S.D. 


t 


3 


19 


2.52 


0.95 


3.11 


1.33 


z.jk 


0.70 


.1.60 


k 


26 


2.25 


0.U9 


2.56 


0.63 


2.63 


0.58 


0.50 


5 


23 


2.50 


0.U7 


a. 79 


0.57 


2,90 


0.56 


0.9^ 


6 


73 


3.36 


0.80 


3.72 


0.92 


k.96 


1.26 


9.63^* 



NOTE: The negative^ value indicated that the observed posttest meaji 
was less than the predicted posttest meaji* 
^,01 

With the exception of the third grade children^ the observed post- 
test means exceeded those predicted. However ^ for only one groups the 
sixth grades was the difference foimd to be statistically significant. 
The observed posttest mean of the third graders was less than that pre- 
dicted ^ but the difference was not statistically significant. 

To evaluate the prograjn objective related to the performance of the 
paraprofessionals 3 a questionnaire which contained items concerning the 
services and functions performed by the paraprofessionals was completed 
by the teachers who worked with them, Paraprofessionals were also 
asked to complete a questionnaire designed to obtain information con- 
cerning their perceptions of the program as well as their perceptions 
concerning their own. individual strengths Bud weaknesses* 
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Teacheri were asked to indicate the percentage of time they a^d 
pa^aprofes clonals spent in sinall groups large ^oup and individualized 
instruction. Their responses are presented in Table 3. 

Table 5 

Teachers' Estimates of Tline They and Paraprofessionals Spent 

in Instructional Modes 



Time Spent by Paras in* 




11-25^ 






61-751& 




a* small group instruction 
b. individualized instruction 
c* lajrge group instruction ' 




1 

2 
2 


2 

3 
2 


2 






Time Spent by Teachers int 


0-10^ 


11-25^ 


26=Uof^ 




61=75% 


76-100% 


a, small group instruction 

b, individualized instruction 

c, IsLTge group instruction 




k 
k 

1 




1 

2 




2 



Teachers estimated that paraprofaisionali spent the majority of . 
their time In small group and/or individimllzed Instruction, while thay 
themselves spent more time in laa-ge group instruction. These estlmatas 
are paa-allel with activities spaoified in the original program proposal. 
It was intended that paraprofesalonals would work with sinall groups or 
individuals who need supplemental adult asBlstanee. 

Performance of the paraprofessionals was rated hy teachers. These 
ratings are summarized in Table 6. 
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Table 6 

Teacher Ratings of Services or Performance of Paraprofessionals 







Statements 


Ratings 
Mean 


(11=6) 
S.D. 




To what extent do you feel the paraprofesgionalr 






1. 


is trained to help you with: 

a* reading initruction in small groupe? 

reading inatruction to individual children? 
c* assistance in reading lab sessions? 


h.67 
h.33 

4.67 


0.47 

0.75 
0.47 


2 . 


ii confident in her ability to approach ajnd work 
with children? 


h.33 


0.75 




considers herself a help to you in your work? 


k.67 


0.47 




is cleajrly aware of her specific duties? 


k,30 


0.76 




In oTor class sitmtion: 

children are friendly and courteous to the para= 
pr of es s lonal t 


4.83 


0.37 


6. 


children show confidence In the paraprofessional. 


4.67 


0.47 


7. 


children ask paraprofessionals for assistance. 


5.00 


0.00 




children accept directions of the paraprofessional. 


4.83 


0.37 



9. the paraprofessional avoids overdomination of children* k.67 O.U7 



10, children a^e given opportunities by the pMaprofes = 
sional to show initiative and/or leadership* 

11, the relatlonihip between the paraprofessional and the 
teacher is friendly ^ cooperative^ and confidents 

12* the emotional climate' is WOTn and positive* 

13* grouping patterns vary for different activities* 

lU* attention is given to learnings of Individual chil- 
dren as well as to total class and small groups* 

15* the paraprofessional participates In children's 
functioning and learning activities. 



3.80^ l,ii7^ 

k.Bs 0,37 
5*00 0*00 

h.67 oM 

k,50 0,50 
k.50 0.50 



for this Item 
Note I Response Scale 



- S^Excellent or Aljnost Almys* i+=Good or Usually; 
3=Fair or Occasionally! SsPoor or Seldom; 
l=Yery Poor or Almost Never* 



The prop^am proposal specified that p^aprofessionals should "dem- 
onstrate a level of adequate or better performance," A mea^ rating of 
3,5 TOB aacepted to be the minimum level of "adequate performance" In 
this report. Mean teacher ratings for all fifteen items exceeded this 
minimum level, Paraprofessionals were perceived to he well trained ^ to 
be confident in their abilities to assist teachers ^ and to be amre of 
their duties euid responsibilities, The emotional climate was rated as 
excellent by all of the teachers who responded, Ihii was also reflected 
in the items concerned with relationships between children and the para- 
professionals , 

Paraprofessionals completed a questionnaire concerning the progr^ 
and their own activities. They viewed their most important tasks as 
working with children who were having difficulties in school. Most of 
those who responded indicated that they had several years of experience 
as paraprofessionals either at P,S. 327K or other schools. They all 
felt that the prograjn was beneficial to children and they did not rrmke 
any specific recoramendations for program improvement, 
V. mOGRAM SmENGTHS MD ^?EAraESSES 

Several prograjn strengths should be noted. The supplemental reading 
services provided by the program were well integrated with the regular 
reading program. The presence of the regular classroom teachers and 
paraprofessionals at the reading lab sessions enabled teachers to be 
familiar with reading difficulties diagnosed in the la.b and to extend 
the treatments to the regular classroom. 

^ovision for secretarial assistance in the program was ejn excel- 
lent idea. Frequently "extra" prograjns in schools are adeqmtely staffed 
from an instructional viewpolntj but the demands placed on supportive 
services^ such as the secretaries j are often excessive* 
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One major program weakness ms the failm'e to begin the lab prograjfl 
earlier in the year. It appears that the delay in initiating the program 
vas beyond the control of school pergonnelp The program was not approved 
\mtil the fall, and this resulted in a delay in ordering lab equipment 
and materials. The reading lab treatnient aspect of the program will 
have been in effect for only two months when the City-wide achievement 
tests are administered in April. Some elements of the reading lab might 
have been implemented earlier in the school year, 

VI . RECO^NDATIONS 

The following reconmiendatlons are made: 

1, The program appears to be providing services to a target popu- 
lation much in need of supplemental reading instruction. On the basis 
of the standardized test results It is felt that the program should be 
continued. 

2* School personnel should examine program activities and services 
provided for third grade pupils. While results of the Gilmore Oral Read - 
ing Test indicated substantial gains in reading achievement for these 
children, similar results on the written achievement tests were not ob- 
tained. Performance on the New York City Reading Comprehension subtest 
was significantly less than predicted, 

3# In planning for future yea^s and in developing proposals for 
funded programs 3 the staffing needs of the school should be carefully 
assessed. The progrM was initially intended to service 6OO children 5 
but because of declining school enrolljnent and the fact that many chil- 
dren in the school receive services from other programs ^ the current 
target population numbers 300. Of this number^ half are serviced by 
paraprofessionals funded under Title I but they attend the Reading Lab 
funded by Umbrella monies. This recommendation shoiild not be Interpreted 
to mea that the progrem should be discontinued, but that the school 
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should assess the needs of the children in view of services available. 
Children in '^he school^ as previously stated^ are in need of supplemental 
raading instruction* 
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••DIAGNOSTIC-PRESCRIPTIVE RE^mG SERVICES - 
P.S, kO, QTOENS " 
Prepared by* Linda I^ons 

I. OTTRODUCTION 
In many instmcas, the early identification of pupils' academiG 
and adjustment problems may forestall more severe disabilities* In 
order to meet the needs of pupils at the early elemental level, a 
program of Diagnostic -Prescriptive Reading Services =was instituted 
at P.S. UO5 Queens, to raise the reading and adjustment levels of 
approximately 300 eligible pupils in grades one through three* There 
v/ere two program components* astructional services in reading were 
to be provided by three teachers, who were funded imder Title I 
monies 5 and six educational assistants. The teachers were to de- 
vise and implement an individualiaed program according to pupil 
need. Additionally 5 the teachers were to keep records of pupil 
progress, to provide in*-service training for paraprofessionals, and 
to confer with classroom teachers , parents 5 and the administrative 
and guidanca staff in order to evaluate pupil progress* The educa« 
tional assistants were to assist with small -group instruction, 
testing, and record keeping, under the supervision of the teachers. 
Small groups of yoimgsters were to be scheduled for dally Instructlon- 
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al sessions. To perfom the many clerical duties in eonjunotion with 
the reading prograjn^ another educational assiit^t was to he aisigned 
to maintain an invento^ of teacher-made aaterlalSj as well as materials 
available in the Umbrella Resource Eoom. Under the second component^ 
the guidance staff were to define specific areas of difficulty and to 
arrange for contacts with appropriate agencies in instances where pupils 
msy^ demonstrate personal or school^related adJuBtment problem, A 
part-time psychologist was to administer tests j where these sewices 
were warrantedj and to discuss recoMaendations with parents 5 teachers, 
the guidance staff^ md the project coordtoator* A team of medical 
consultants was to he available on a part-time basis ^ to ev^uate 
problem areas and to consult with parents md teachers with regard 
to findings. 



Frogram obJectiveSj as stipulated in tha prcpctal for fundingj 
were twofold j (1) to identify 3 dia^ovm am ^va?at laarning and per- 
ceptual reading problems | and (2) to ixi^^vtify and diagnose school y 
adjustment problem. The following evfti .^^"itior procedures were 
employed : 

(1) Observations were made of all aspects of the program, and 
interviews were held with the coordijaator, :.hr.:- professional 
and paraprofessional staff, as well as a saEo.p=llng of pupils. 

(2) Metropolitan Achievement Test Scores In Readl',i:j were 

%; analyzed on a pre^and post^^test basis* It war^ expected 
that pupil gains In reading during the course of the 
school year would exceed those shown prior to parti- 
cipation in the prograin* 

(3) Pupil records were examined and e^raluatad at .the end of 
the school year. It was expact^-id ^ hs.t| fbr 80^ of the 
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pupils referred for school adjustinent difficulties, problems would 
be defined and Initial contact made with an appropriate agency. 

Ill, mOGRAM TN^lElffiNTATION 

Reading Component 

The three laboratories functioned smoothly throughout the school 
year. Two laboratories each serviced a total of 55 second graders; one 
laboratory^ a total of 65 third graders* The only change in instructional 
organization was made in the second grade laboratories; in Marchj 23 first 
graders were accommodated* Several first grade pupils were integrated 
within each of the second grade laboratory classes ^ and diagnostic 
measures were administered to assess pupil needs. Small groups of 9 
to 13 yoLingsters were scheduled for four instructional sessions per week. 
In view of the fact that a teacher and two educational assistants were 
assigned to each laboratory^ the staff =pupil ratio facilitated intensive 
remediation, 

A variety of software was utilized to develop phonics 5 comprehen- 
sion 3 and vocabulary skills. In addition to that noted in the Interim 
Report on this program 5 hardware equipment in use at the laboratories 
later In the school year included System 80 and Spell-binders. Ms,ny 
rexographed teacher-nmde materials were devised to reinforce specific 
skills. Additional software materials 5 as well as filmstrips and 
cassettes 5 were often borrowed from the resource room. The labora- 
tories were organized to permit flexible pupil groupings , As a re- 
sultj activities were devised on an individual or small group basis 
to rem.edy specific skill deficiences* During the spring semesters 
third graders were given reading materials , and were awarded certifi- 
cates after having completed ten books. This activity appeared to 
be highly motivating to yoimgsters and tended to foster a positive 
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attitude toward reading, Eeoords of pupil activities were kept in 
individual folders. The staff planned prescriptive measures during daii^r 
preparation periods. 

Continuity of services was maintained iji several ways. Conferences 
with classroom teachers were held reffid.arly3 aa well as Infomally^ m 
the need arose. The lahoratory staff conferred with the guidance 
counselor and psychologist ^ where farther assessment of pupil needi 
was warranted. A workshop was held for sacond grade parents ^ during 
which pupil activities were discussed and deswnstrations were given 
of materials in use at the laboratories. The educational assistant 
assigned to catalogue materials in the resource room has maintained an 
inventoiy of materials made availahle to personnel funded under the 
program, Additionrily^ this paraprofessionaL has assisted the guidmce 
counselor by typing reports of pupil assessments. 
Guidance component 

The guidance counselor^ who assumed this position in mid-Novemher^ 
has screened youngsters for special class placement or referrals to 
appropriate cormnunity agencies. The nmiher of pupils referred to the 
guidance counselor for evaluation indicated a need for sew^ices far 
greater than was anticipated. After having conferred with the class- 
room teacher, and, where appropriate, the reading laboratory staff, 
the guidance counselor offered individual counseling and met with 
parents to discuss appropriate mems of remedying pupils difficulties, 
live workshops were held throi;^hout the school year, to apprise parents 
of their role in helping yoTOgsters with perceptual, reading, and 
adjustment difficulties. Attendance at these workshops Increased 
substantially during the spring term, and the response was quite 
favorable* 
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Furtlierj the guldmce comielor has contaGted various coE^mity 
^mcles, in instances where pupils demDnstrated problema which 
warranted medical treatmenti social services^ or counseling* Youngs- 
teri were referred to the Neighborhood Centeri Queens Child Guidmce 
Clinic 3 aid the Bora au of Child Welfare j in Instmces where Individuri 
or fiMly iituationi tadicated a need for therapeutic measures, 
Yoimgstera with difficulties of a medical nature were referred to the 
Carter Commumity Health Center* Because pupils were treated for health 
problenm at coimimity ^mcies^ the sewices of medical consultmts were 
not req^uired. Nonetheless^ in many casesj agencies were slow to re- 
lay reports of medical or therapeutic serv^ices to the ichooli 

The educational assistant asiigned to this component i ^ong with 
the guid^ce counselor^ made home visits and often accompmled pupils 
to keep their appointments at various agencies. On occasions the 
educational assistant also met with yQungsters whose hehavior war- 
ranted tempo ra]^ removal from the classroom. This servica enabled 
pupils who were momentarily upset to discuss their feelings with 
a sympathetic adults and .restored a favorable classroom atmc here. 

In instances where additional pupil assessment was warranted^ 
the guidance cotoselor referred youngsters to the psychologist ^ who 
was available on a part--time basis. During the 197^"75 school year^ 
the psychologist tested 1+2 pupils. Written reports were completed^ 
which included results of various diagnostic tests ^ intellectual 
and personality assessments ^ and recommendations for special class 
placements medical treatment, or other therapeutic measures. The 
psychologist conferred with teachers and parents with regard to 
the evaluation of individual needs. 
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To aeterrnlne if participants had Bhoim significant growth in 
reading, Metropolitan Achievement Teita were admtoiitered ear^ in 
the programs as well as at the end of the ichool year* Because it 
was not psssihle to compute predicted ^it<-tegt scores for first and 
second graders, data for these youngsters were analysed on a pre^ 
and post-test basis. These results are presented in Tables 1 and 2. 



Table 1 

Haw Scores for Participating Papils in Grade 1 
Metropolitan Achievement Tests in Reading-Brlmer Level 



Sub^Test N 


Pre^Test Scores 


Post«Test Scores 






Mean SD 


Mean SD 


t 


Word Malysls ^ 


16.U7 3M 


32*76 3*07 


ir.09^ 


Total Reading 21 


17*62 3.31 


25.62 3.^9 


8,37#^ 




significant at the , 


,01 level 








Table 2 






Grade Ec 


lulvalent Scores 


for Participating Pupils 


In 



Grade 2 

Metropolitan Achievement Tests in Reading — ^ 

Prlma^ I Level 



Pre-Test Scores Post*-Test Scores 



Sub -Test 




Meaii 


SD 


Mean 


SD 


t 


Word Knowledge 


'88 


1.60 


.31 




.78 


13.09** 


Word Analysis 


85 


1.51 


.SB 


2.29 


.82 


9.78** 


Reading 


85 


1.56 


.23 


2.70 


.90 


ll,70*^fr 


Total Beading 


85 


1.61 


.a 


2.55 


. .69 


lit. 33** 



^^significant at *01 level 
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Data Indicated that gains on all reading iub-tests were elgiiflGtot. 
The program oTDjtctive wss met with regard to first 'and stcond gradt pupils^ 
who ihowed iubstantial growth In reading thro'ughout the course of the 
school year* 

For partioipanti in grade threes it was possihle to asaesi pupil 
growth in reading hy utilizing the method of historical regreiiion* 
Actual grade aqulTelent seores were compared with predicted i^coreij 
hased on pupils- performance prior to plac^ent In the program* 
These reiiJ.t8 are summarized in Table 3, 

Table 3 

Grade Eq^ulvalmt Scores For Participating Pupils in Grade 3 
MetropolltajL Achievement Tests In Reading «*-Blementary Level 



Sub -Test 


N 


PresTest 
Mean 


Scores 

SD 


Predict « 

Mean 


sd Post-Test 
SD 


Actual Post 


Test t 


Word Hiowledge 


h9 


2.51 


.1+8 


3.11 


.67 


2.30 .51 


-7.09** 


Reading 


k9 


2. In 


.50 


2.98 


.70 


2.22 .1+8 


-6.38** 



NOTE: Hie negative t_ value indicated that the 
■^■^significant at .01 level Actual Posttest Mean ms less than the 

Predicted Posttest Mean* 

Results indicate that the reading scores obtained by third grade 
pupils following program participation did not ^ceed those expected on 
the basis of their past perfomance* Although prescriptive measures 
were devised and implemented for third graders ^ It becme evident 
that many youngsters »chibited visual/percepfcual difficulties which 
were not diagnosed until later in the school tem* As a result^ m^^ 
third graders 5 despite intensive remediation showed no improvement. 

Overalls when considering the performmce of a majority of par- 
tlGlpinte, substantia gains In reading were made. Personnel who 
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staffed the reading laboi'atories inititutsd a fl^ible approaGh to 
meet pupil needs ^ and utilised a variety of materlrii to remedy spe- 
cific weaioiesses. Pupils appeared to be Intereited In completing 
■various instmctlonal tasks, and in developtog baiic skills * However^ 
the perfomence of third graders was extremely disappointing md merite 
extensive review in order to determine If some program modification 
vov^d be more effective to ralstog the reading Iwd. of these parti- 
cipants < 

As an index of the effectiveness of the galdance Gomponentj re- 
cords of agency referrals initiated by the guidanGe eouinselor thro^h- 
out the course of the school year were examiaed. ResiiLts of these 
analyses are presented in Table 



Table k 

Agency Referrals for Participating Pupils 



Paplls referi'ed to gTildance eounsaloi' 


113 


Pupils who required agency Intervention 


83 


Pupils referred to agencies 


77 


1 




Area of Intervention 




Testing/special, class placement 


35 


Coiniseling 


32 


Medical assistance 


26 



In some instmces^ pupils were referred to several agencieB 



Of the 113 pupils who were referred to the giiidance coimse- 
lor between November^ 197^5 and jTmei 1975i 83 yoimgsters ware in 
need of further assistance provided by varioTis oommimity agencies* 
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Thm other 30 pupils met with the guidance comielor because of 
temporary emotion^ u:pet^ and further action- appeared to be mi- 
necesiarjr. Agency contact was mtde^ then for 77 of the 83 pupils 
in need of these servlcai. In view of the tmt that initial 
contacts were made forga^Sfoof those pupils whose adjustment 
level warranted intewention^ it is evident that the objective 
of this program component was met. The guidance comselor and 
psychologist identified the speclfle problem areas of many yoimgs- 
ters^ and made referrals, to appropriate agencies for assistance 
to pupils in need of additional testing^ coimseling^ or medical ser- 
vices , 

Personnel who staffed the reading and guldmce components 
constituted the greatest program strengths. The reading teachers ' 
d^lsed and implemented prescriptive measures for partieipmts on a 
small -group basis. The conscientious efforts of the guidance corni- 
selor who initiated and maintained contact with parents ^ as well 
as many coimmmity agencies 3 fostered a positive approaGh to the 
treatment of many pupils* personal and school -related problen^. 
The only discernible weataiess of the guid^ce component arose as 
the result of an unusuaia^r large case load, Consetuently^ it was 
not possible to offer Gounseling on an on-going basis to those 
youngsters who cpuld derive Gonsiderable benefit from such sessions. 
Mthough the reading laboratories were effective in upgrading the ■ 
skills of first md second graders 5 the program was not successful 
in m_eeting the needs of third grade pupils. The instructional 
approach utilised to remedy deficiencies of these pupils warranta ' 
re -»examin at ion , 
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The academLG adjustment ImvmlB of memy pupils at P»0. 
ifO warrmt contiiniation of the reading and ffoidance progr^, 
Theie iawices are vltal!^ im^rtMit In order to resolve 
pupils' learning md adjuatnient prohleD^, 

It wo-id-d be advm,t^eoui to ^Mnlstar itandardlied^ dia^ostic 
tests in reading to all participants early in the progrm. 
These measures woaid famish imTB precise Infomatlon with 
regard to Indlyidual skill weataesses and pupil needs. Such 
diagnostic scores woid.d he particularly vriuahle for third 
graderi. 

It would he helpf^j as well^ to exandne all pupils Inltl^^ 
for visuals percepturi^ and hearing prohlems. Early ldentifl« 
cation of these disahilities md provision for treatment or 
compensatory measures might increase papll performance 
throughout the course of the school year. 

The services of medical consultants are not reg.uired. Biplls 
who need such service^ can generally receive treatment for 
medical problems through appropriate community agencies. 
The sizable nmber of pupils who demonstrate adjustment 
problems warrmts ^panslon of the ^Lld^ce etaff. With 
the allocation of Mother guldm,ce coTOselors It would 
be possible to remove children ft^om the classroom who 
are moment arl^ upset ^ to Institute IndlvlduiL md group 
sessions for ma^ pupils ^ and to maintain on-going coimmlca- 
tion with comnmity agencies. It would be advantageous to 
allocate the services of another paraprofessionali to assist 
with home visits and to accomp^r pupils to varloiis comffiunity 
agencies. 
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VI, sumARY 

To raise the raiding and adJuBtment levels of approximately 300 
mderaohitmreri in grades one throiigh thraei a program of Di^nostiG- 
I^esarlptlve ReadiEig Sewlces wai initituted at P.S* ko^ Qiisens* 
The reading component -was compriaed of three lahoratoriei ^ each 
staffed by a teacher and two educational aasistmti. An indlYiduallied' 
md small -*group approaoh waa devised accord^ig to ^pil need* A 
variety of software was utilized to the lahoratoriesi additional 
materials^ as well as hardware eq^uipmentj were horrowed from the 
resouroe room to reinforoe basic skills* An additional paraprofession- 
al was allocated to cataLogiie and maintain materials. To ensure 
continuity of sewices^ conferences were held with classroom teachers 
and the guidance staffs bb the need arose* The guidance component^ 
comprised of a part-time psychologist said a guidance cotmselor who 
were assisted hy a paraprofessional| was instituted to waluate 
the needs of many pupils. Home visits were made and five parent 
workshops were held by the guidmce coimselor during the school 
year. Many pupils were referred to agencies for counseling Bikd 
medical assistance. Because papils* physical needs were met by com*- 
mmity agencies ^ the services of medical consiitants were not 
required, lor the first ond second grade pupil participants ^ 
fi;ains in reading were significant ^ which indicated that 5 over^l^ 
objectives of the reading component were met at these grade levels. 
ProgrMi objectives were not met at the third grade level, toitlri 
contact was made with appropriate agencies for nearly all pupils in 
need of these services. Referrals indicated that the objective of 
the guideaiQe component was met. Reading md guidance personnel 
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aonstltuted the graatest progrMi itrangths. Recoromendations included program 
recyoliiig and early adminiitration of standard led^ dlagnoitlG meaiwes in 
readlngj as well as vlsual/perceptml testi. 
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